Apr 15 14:29:52 devstack cinder-volume[73276]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 14:29:52 devstack cinder-volume[73276]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 14:29:52 devstack cinder-volume[73276]: we strongly recommend against using it for new projects.
Apr 15 14:29:52 devstack cinder-volume[73276]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 14:29:52 devstack cinder-volume[73276]: framework.  For more detail see
Apr 15 14:29:52 devstack cinder-volume[73276]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 14:29:52 devstack cinder-volume[73276]:   import eventlet  # noqa
Apr 15 14:29:54 devstack cinder-volume[73276]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:29:54 devstack cinder-volume[73276]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:29:54 devstack cinder-volume[73276]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:29:54 devstack cinder-volume[73276]: INFO dbcounter [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Registered counter for database cinder
Apr 15 14:29:54 devstack cinder-volume[73276]: DEBUG oslo_db.sqlalchemy.engines [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG dbcounter [-] [73276] Writer thread running {{(pid=73276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.rpc [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.rpc [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_db.sqlalchemy.engines [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.volume.manager [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Determined volume DB was empty at startup.
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG cinder.volume.manager [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73276) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.volume.manager [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 14:29:55 devstack cinder-volume[73276]: WARNING stevedore.named [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 14:29:55 devstack cinder-volume[73276]: WARNING castellan.key_manager [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:29:55 devstack cinder-volume[73276]: WARNING cinder.keymgr.conf_key_mgr [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG cinder.volume.drivers.lvm [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73276) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_concurrency.processutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73276) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_concurrency.processutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.243s {{(pid=73276) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_db.sqlalchemy.engines [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.rpc [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.rpc [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 15 14:29:55 devstack cinder-volume[73276]: WARNING stevedore.named [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 14:29:55 devstack cinder-volume[73276]: WARNING castellan.key_manager [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO cinder.volume.manager [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_db.sqlalchemy.engines [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:29:55 devstack cinder-volume[73276]: INFO oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Starting 1 workers
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Started child 73380 {{(pid=73276) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Full set of CONF: {{(pid=73276) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] ******************************************************************************** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Configuration options gathered from: {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] ================================================================================ {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] allow_availability_zone_fallback = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] allow_compression_on_image_upload = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] allowed_direct_url_schemes     = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] api_rate_limit                 = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] auth_strategy                  = keystone {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] az_cache_duration              = 3600 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_availability_zone      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_host                   = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_name                   = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_stats_polling_interval = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backup_api_class               = cinder.backup.api.API {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backup_name_template           = backup-%s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backup_use_same_host           = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backup_use_temp_snapshot       = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] chap_password                  = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] chap_username                  =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_internal_tenant_project_id = 3f7a6e1fd93947638fd47febb54c8021 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_internal_tenant_user_id = 58db37962f914b239dfa31960d5b9489 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cloned_volume_same_az          = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cluster                        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] compression_format             = gzip {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] config_dir                     = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] config_source                  = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] control_exchange               = openstack {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73380]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] debug                          = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] default_availability_zone      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] default_group_type             = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] default_volume_type            = lvmdriver-1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] disk_geometry                  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] driver_client_cert             = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] driver_client_cert_key         = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] driver_data_namespace          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] driver_ssl_cert_path           = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] driver_ssl_cert_verify         = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] driver_use_ssl                 = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] enable_force_upload            = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] enable_new_services            = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] enable_unsupported_driver      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] enforce_multipath_for_image_xfer = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] filter_function                = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_api_insecure            = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_api_servers             = ['http://192.168.122.189/image'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_api_ssl_compression     = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_ca_certificates_file    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_certfile                = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_keyfile                 = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_num_retries             = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance_request_timeout         = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] goodness_function              = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] graceful_shutdown_timeout      = 5 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] group_api_class                = cinder.group.api.API {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] host                           = devstack {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_compress_on_upload       = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_conversion_address_space_limit = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_conversion_cpu_limit     = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_conversion_disable       = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_upload_use_cinder_backend = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_upload_use_internal_tenant = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_volume_cache_enabled     = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_volume_cache_max_count   = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] init_host_max_objects_retrieval = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] iscsi_target_flags             =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] iscsi_write_cache              = on {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] iser_helper                    = tgtadm {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] iser_ip_address                = 192.168.122.189 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] iser_port                      = 3260 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_color                      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_config_append              = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_dir                        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_file                       = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_options                    = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_rotate_interval            = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_rotate_interval_type       = days {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] log_rotation_type              = none {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] max_age                        = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] max_logfile_count              = 30 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] max_logfile_size_mb            = 200 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] max_over_subscription_ratio    = 20.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] message_reap_interval          = 86400 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] message_ttl                    = 2592000 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] monkey_patch                   = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] monkey_patch_modules           = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] my_ip                          = 192.168.122.189 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] no_snapshot_gb_quota           = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] num_iser_scan_tries            = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] num_shell_tries                = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] num_volume_device_scan_tries   = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] nvmeof_conn_info_version       = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] nvmet_ns_id                    = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] nvmet_port_id                  = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_max_limit                = 1000 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_volume_ext_list          = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_volume_listen_port       = 8776 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_volume_use_ssl           = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] osapi_volume_workers           = 2 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] per_volume_size_limit          = -1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] periodic_fuzzy_delay           = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] periodic_interval              = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] public_endpoint                = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] publish_errors                 = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_backup_gigabytes         = 1000 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_backups                  = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_gigabytes                = 1000 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_groups                   = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_snapshots                = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] quota_volumes                  = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] rate_limit_burst               = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] rate_limit_except_level        = CRITICAL {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] rate_limit_interval            = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] reinit_driver_count            = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] replication_device             = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] report_discard_supported       = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] report_interval                = 120 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] reservation_clean_interval     = 86400 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] reservation_expire             = 86400 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] reserved_image_namespaces      = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] reserved_percentage            = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] rpc_response_timeout           = 120 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] run_external_periodic_tasks    = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] scst_target_driver             = iscsi {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] scst_target_iqn_name           = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_down_time              = 720 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] shell_completion               = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] snapshot_name_template         = snapshot-%s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] snapshot_same_host             = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] split_loggers                  = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] state_path                     = /opt/stack/data/cinder {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] storage_availability_zone      = nova {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] storage_protocol               = iSCSI {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] syslog_log_facility            = LOG_USER {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] target_helper                  = lioadm {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] target_ip_address              = 192.168.122.189 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] target_port                    = 3260 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] target_protocol                = iscsi {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] target_secondary_ip_addresses  = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] trace_flags                    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] transport_url                  = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] until_refresh                  = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_chap_auth                  = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_default_quota_class        = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_journal                    = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_json                       = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_multipath_for_image_xfer   = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_stderr                     = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] use_syslog                     = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] verify_glance_signatures       = enabled {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_api_class               = cinder.volume.api.API {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_backend_name            = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_clear                   = zero {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_clear_ionice            = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_clear_size              = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_copy_bps_limit          = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_dd_blocksize            = 1M {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_name_template           = volume-%s {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_service_inithost_offload = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volume_usage_audit_period      = month {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] zoning_mode                    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.admin_password = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.admin_token = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.admin_user  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_protocol = https {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_section = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_type   = password {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_uri    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.auth_version = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.cache       = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.certfile    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.identity_uri = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.insecure    = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.interface   = public {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.keyfile     = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_password =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcache_username =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.region_name = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.service_type = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.backend                  = dogpile.cache.null {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.backend_argument         = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.backend_expiration_time  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.config_prefix            = cache.oslo {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.debug_cache_backend      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.enable_retry_client      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.enable_socket_keepalive  = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.enabled                  = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.enforce_fips_mode        = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.expiration_time          = 600 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_dead_retry      = 300 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_sasl_enabled    = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.password                 = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.proxies                  = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.redis_db                 = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.redis_server             = localhost:6379 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.retry_attempts           = 2 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.retry_delay              = 0.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.socket_keepalive_count   = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.socket_keepalive_idle    = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.socket_keepalive_interval = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.socket_timeout           = 1.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.tls_allowed_ciphers      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.tls_cafile               = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.tls_certfile             = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.tls_enabled              = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.tls_keyfile              = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cache.username                 = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] coordination.backend_url       = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.asyncio_connection    = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.asyncio_slave_connection = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.backend               = sqlalchemy {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.connection            = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.connection_debug      = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.connection_parameters =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.connection_recycle_time = 3600 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.connection_trace      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.db_inc_retry_interval = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.db_max_retries        = 20 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.db_max_retry_interval = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.db_retry_interval     = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.max_overflow          = 50 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.max_pool_size         = 5 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.max_retries           = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.pool_timeout          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.retry_interval        = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.slave_connection      = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.sqlite_synchronous    = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.synchronous_reader    = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] database.use_db_reconnect      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.connection_string     = messaging:// {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.enabled               = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.es_doc_type           = notification {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.es_scroll_size        = 10000 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.es_scroll_time        = 2m {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.filter_error_trace    = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.hmac_keys             = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.sentinel_service_name = mymaster {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.socket_timeout        = 0.1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.trace_requests        = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler.trace_sqlalchemy      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler_jaeger.process_tags   = {} {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] profiler_otlp.service_name_prefix = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.enforce_new_defaults = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: WARNING oslo_config.cfg [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.enforce_scope      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.policy_default_rule = default {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.group          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.helper_command = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] privsep_osbrick.user           = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.group         = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.helper_command = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] cinder_sys_admin.user          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.auth_section      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.auth_type         = password {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.cafile            = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.certfile          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.collect_timing    = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.insecure          = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.keyfile           = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.send_service_user_token = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.split_loggers     = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] service_user.timeout           = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.auth_section            = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.auth_type               = password {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.certfile                = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.collect_timing          = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.insecure                = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.keyfile                 = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.region_name             = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.split_loggers           = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] glance.timeout                 = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.backend_availability_zone = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73380]: INFO cinder.volume.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.chap_password = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.chap_username =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.disk_geometry = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.driver_client_cert = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.driver_data_namespace = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.driver_use_ssl = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.extra_capabilities = {} {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.filter_function = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.goodness_function = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.iscsi_target_flags =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.iser_port     = 3260 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.lvm_share_target = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.lvm_type      = auto {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.replication_device = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.report_discard_supported = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.target_helper = tgtadm {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.target_port   = 3260 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.target_protocol = iscsi {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.trace_flags   = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.use_chap_auth = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_backend_name = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_clear  = zero {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_reports.file_event_handler = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_reports.log_dir           = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.backend_host       = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.chap_password      = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.chap_username      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.disk_geometry      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.driver_client_cert = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.extra_capabilities = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.filter_function    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.goodness_function  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.iser_helper        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.iser_port          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.lvm_type           = auto {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.replication_device = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.report_discard_supported = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.reserved_percentage = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.scst_target_driver = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.storage_protocol   = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.target_ip_address  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.target_port        = 3260 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.trace_flags        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_clear       = zero {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] lvmdriver-1.volumes_dir        = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_notifications.driver = [] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] key_manager.fixed_key          = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.barbican_api_version  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.barbican_endpoint     = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.barbican_endpoint_type = public {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.barbican_region_name  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.cafile                = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.certfile              = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.collect_timing        = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.insecure              = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.keyfile               = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.number_of_retries     = 60 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.retry_delay           = 1 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.send_service_user_token = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.split_loggers         = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.timeout               = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.verify_ssl            = True {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican.verify_ssl_path       = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.auth_section = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.auth_type = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.cafile   = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.certfile = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.collect_timing = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.insecure = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.keyfile  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.split_loggers = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] barbican_service_user.timeout  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.approle_role_id          = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.approle_secret_id        = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.kv_mountpoint            = secret {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.kv_path                  = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.kv_version               = 2 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.namespace                = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.root_token_id            = **** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.ssl_ca_crt_file          = None {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.timeout                  = 60.0 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.use_ssl                  = False {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:29:55 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] ******************************************************************************** {{(pid=73276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:55 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:55 devstack sudo[73384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 15 14:29:55 devstack sudo[73384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:56 devstack sudo[73384]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:56 devstack sudo[73567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:29:56 devstack sudo[73567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:56 devstack sudo[73567]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.511s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:29:56 devstack cinder-volume[73380]: INFO cinder.brick.local_dev.lvm [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:56 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:56 devstack sudo[73751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:29:56 devstack sudo[73751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:57 devstack sudo[73751]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:57 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:57 devstack cinder-volume[73380]: DEBUG cinder.brick.local_dev.lvm [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73380) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 15 14:29:57 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:57 devstack sudo[73909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:29:57 devstack sudo[73909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:58 devstack sudo[73909]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.831s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:58 devstack sudo[74048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:29:58 devstack sudo[74048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:58 devstack sudo[74048]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:58 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:58 devstack sudo[74079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 15 14:29:58 devstack sudo[74079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:59 devstack sudo[74079]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:59 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.446s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:59 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:59 devstack sudo[74082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:29:59 devstack sudo[74082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:29:59 devstack sudo[74082]: pam_unix(sudo:session): session closed for user root
Apr 15 14:29:59 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:29:59 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:29:59 devstack sudo[74087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:29:59 devstack sudo[74087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:00 devstack sudo[74087]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:00 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:00 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:00 devstack sudo[74091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:00 devstack sudo[74091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:00 devstack sudo[74091]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:00 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:00 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:00 devstack sudo[74099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:30:00 devstack sudo[74099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:01 devstack sudo[74099]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:01 devstack sudo[74103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:30:01 devstack sudo[74103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:01 devstack sudo[74103]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:01 devstack cinder-volume[73380]: INFO cinder.volume.drivers.lvm [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:01 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:01 devstack sudo[74189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:30:01 devstack sudo[74189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:02 devstack sudo[74189]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:02 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:02 devstack cinder-volume[73380]: DEBUG cinder.volume.drivers.lvm [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Updating volume stats {{(pid=73380) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 14:30:02 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:02 devstack sudo[74226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:30:02 devstack sudo[74226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:02 devstack sudo[74226]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:02 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:02 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:02 devstack sudo[74368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:02 devstack sudo[74368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:03 devstack sudo[74368]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:03 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:03 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:03 devstack sudo[74372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:30:03 devstack sudo[74372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:03 devstack sudo[74372]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:03 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:03 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:03 devstack sudo[74376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:03 devstack sudo[74376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:04 devstack sudo[74376]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:04 devstack cinder-volume[73380]: INFO cinder.volume.driver [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG cinder.volume.driver [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73380) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG oslo_db.sqlalchemy.engines [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG dbcounter [-] [73380] Writer thread running {{(pid=73380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG cinder.db.sqlalchemy.api [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Building query based on filter {{(pid=73380) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG cinder.image.image_utils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73380) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 14:30:04 devstack cinder-volume[73380]: INFO cinder.keymgr.migration [None req-2ee9e0f4-32a3-4aea-91bb-f226e34996c0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG cinder.volume.drivers.lvm [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Updating volume stats {{(pid=73380) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:04 devstack sudo[74380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:30:04 devstack sudo[74380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:04 devstack sudo[74380]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:04 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:04 devstack sudo[74386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:04 devstack sudo[74386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:05 devstack sudo[74386]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:05 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:05 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:05 devstack sudo[74391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:30:05 devstack sudo[74391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:05 devstack cinder-volume[73276]: DEBUG dbcounter [-] [73276] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:30:05 devstack sudo[74391]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:05 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:05 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:05 devstack sudo[74397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:05 devstack sudo[74397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:06 devstack sudo[74397]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG cinder.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Notifying Schedulers of capabilities ... {{(pid=73380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:30:06 devstack cinder-volume[73380]: INFO cinder.volume.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Driver initialization completed successfully.
Apr 15 14:30:06 devstack cinder-volume[73380]: INFO cinder.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Initiating service 2 cleanup
Apr 15 14:30:06 devstack cinder-volume[73380]: INFO cinder.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Service 2 cleanup completed.
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG cinder.service [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Creating RPC server for service cinder-volume {{(pid=73380) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG cinder.service [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73380) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 14:30:06 devstack cinder-volume[73380]: INFO cinder.volume.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG cinder.volume.drivers.lvm [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Updating volume stats {{(pid=73380) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:06 devstack sudo[74400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:30:06 devstack sudo[74400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:06 devstack sudo[74400]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:06 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:06 devstack sudo[74460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:06 devstack sudo[74460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:07 devstack sudo[74460]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:07 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:07 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:07 devstack sudo[74463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:30:07 devstack sudo[74463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:07 devstack sudo[74463]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:07 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:07 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:30:07 devstack sudo[74467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:30:07 devstack sudo[74467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:30:08 devstack sudo[74467]: pam_unix(sudo:session): session closed for user root
Apr 15 14:30:08 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:30:08 devstack cinder-volume[73380]: INFO cinder.volume.manager [None req-22c6ccf0-259c-4928-b99c-9756b13d1642 None None] Driver post RPC initialization completed successfully.
Apr 15 14:30:16 devstack cinder-volume[73380]: DEBUG dbcounter [-] [73380] Writing DB stats cinder:SELECT=3 {{(pid=73380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:30:18 devstack cinder-volume[73380]: DEBUG dbcounter [-] [73380] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:31:25 devstack cinder-volume[73380]: DEBUG oslo_service.periodic_task [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73380) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:31:25 devstack cinder-volume[73380]: DEBUG cinder.volume.drivers.lvm [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Updating volume stats {{(pid=73380) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 14:31:25 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:31:25 devstack sudo[79301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:31:25 devstack sudo[79301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:31:26 devstack sudo[79301]: pam_unix(sudo:session): session closed for user root
Apr 15 14:31:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:31:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:31:26 devstack sudo[79311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:31:26 devstack sudo[79311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:31:26 devstack sudo[79311]: pam_unix(sudo:session): session closed for user root
Apr 15 14:31:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:31:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:31:26 devstack sudo[79315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:31:26 devstack sudo[79315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:31:27 devstack sudo[79315]: pam_unix(sudo:session): session closed for user root
Apr 15 14:31:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:31:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:31:27 devstack sudo[79321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:31:27 devstack sudo[79321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:31:27 devstack sudo[79321]: pam_unix(sudo:session): session closed for user root
Apr 15 14:31:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:31:27 devstack cinder-volume[73380]: DEBUG cinder.manager [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Notifying Schedulers of capabilities ... {{(pid=73380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:32:18 devstack cinder-volume[73380]: DEBUG dbcounter [-] [73380] Writing DB stats cinder:SELECT=1 {{(pid=73380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:32:18 devstack cinder-volume[73380]: DEBUG dbcounter [-] [73380] Writing DB stats cinder:UPDATE=1 {{(pid=73380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:32:25 devstack cinder-volume[73380]: DEBUG oslo_service.periodic_task [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73380) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:32:25 devstack cinder-volume[73380]: DEBUG cinder.volume.drivers.lvm [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Updating volume stats {{(pid=73380) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 14:32:25 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:32:25 devstack sudo[81123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:32:25 devstack sudo[81123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:32:26 devstack sudo[81123]: pam_unix(sudo:session): session closed for user root
Apr 15 14:32:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:32:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:32:26 devstack sudo[81155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:32:26 devstack sudo[81155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:32:26 devstack sudo[81155]: pam_unix(sudo:session): session closed for user root
Apr 15 14:32:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:32:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:32:26 devstack sudo[81172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:32:26 devstack sudo[81172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:32:27 devstack sudo[81172]: pam_unix(sudo:session): session closed for user root
Apr 15 14:32:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:32:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:32:27 devstack sudo[81192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:32:27 devstack sudo[81192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:32:27 devstack sudo[81192]: pam_unix(sudo:session): session closed for user root
Apr 15 14:32:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:32:27 devstack cinder-volume[73380]: DEBUG cinder.manager [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Notifying Schedulers of capabilities ... {{(pid=73380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:33:25 devstack cinder-volume[73276]: INFO oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Caught SIGTERM, stopping children
Apr 15 14:33:25 devstack cinder-volume[73276]: DEBUG oslo_concurrency.lockutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Acquiring lock "singleton_lock" {{(pid=73276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:33:25 devstack cinder-volume[73276]: DEBUG oslo_concurrency.lockutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Acquired lock "singleton_lock" {{(pid=73276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:33:25 devstack cinder-volume[73276]: DEBUG oslo_concurrency.lockutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Releasing lock "singleton_lock" {{(pid=73276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:33:25 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Stop services. {{(pid=73276) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 14:33:25 devstack cinder-volume[73276]: DEBUG oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Killing children. {{(pid=73276) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 14:33:25 devstack cinder-volume[73276]: INFO oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Waiting on 1 children to exit
Apr 15 14:33:25 devstack cinder-volume[73380]: DEBUG oslo_service.periodic_task [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73380) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:33:25 devstack cinder-volume[73380]: DEBUG cinder.volume.drivers.lvm [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Updating volume stats {{(pid=73380) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 15 14:33:25 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:25 devstack sudo[82428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 15 14:33:25 devstack sudo[82428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:26 devstack sudo[82428]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:26 devstack sudo[82431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:33:26 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:26 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:26 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:26 devstack sudo[82434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 15 14:33:26 devstack sudo[82434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:27 devstack sudo[82434]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:27 devstack sudo[82437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 15 14:33:27 devstack sudo[82437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:27 devstack sudo[82437]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.processutils [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG cinder.manager [None req-67b908c8-cb9f-4a73-a904-54f7fb862de5 None None] Notifying Schedulers of capabilities ... {{(pid=73380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.lockutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Acquiring lock "singleton_lock" {{(pid=73380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.lockutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Acquired lock "singleton_lock" {{(pid=73380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:33:27 devstack cinder-volume[73380]: DEBUG oslo_concurrency.lockutils [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Releasing lock "singleton_lock" {{(pid=73380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:33:27 devstack cinder-volume[73380]: WARNING amqp [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 14:33:27 devstack cinder-volume[73380]: WARNING amqp [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 14:33:27 devstack cinder-volume[73276]: INFO oslo_service.backend._eventlet.service [None req-0235e757-d7e5-4a82-8d63-1b3b2c8387b0 None None] Child 73380 exited with status 0
Apr 15 14:33:27 devstack cinder-volume[82441]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 14:33:27 devstack cinder-volume[82441]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 14:33:27 devstack cinder-volume[82441]: we strongly recommend against using it for new projects.
Apr 15 14:33:27 devstack cinder-volume[82441]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 14:33:27 devstack cinder-volume[82441]: framework.  For more detail see
Apr 15 14:33:27 devstack cinder-volume[82441]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 14:33:27 devstack cinder-volume[82441]:   import eventlet  # noqa
Apr 15 14:33:29 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:33:29 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:33:29 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO dbcounter [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Registered counter for database cinder
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_db.sqlalchemy.engines [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG dbcounter [-] [82441] Writer thread running {{(pid=82441) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO cinder.rpc [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO cinder.rpc [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_db.sqlalchemy.engines [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO cinder.volume.manager [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Determined volume DB was empty at startup.
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG cinder.volume.manager [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82441) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO cinder.volume.manager [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 15 14:33:30 devstack cinder-volume[82441]: WARNING stevedore.named [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 14:33:30 devstack cinder-volume[82441]: WARNING castellan.key_manager [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:33:30 devstack cinder-volume[82441]: WARNING cinder.keymgr.conf_key_mgr [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO cinder.volume.manager [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_db.sqlalchemy.engines [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:30 devstack cinder-volume[82441]: INFO oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Starting 1 workers
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Started child 82558 {{(pid=82441) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Full set of CONF: {{(pid=82441) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] ******************************************************************************** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Configuration options gathered from: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] ================================================================================ {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] allow_availability_zone_fallback = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] allow_compression_on_image_upload = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] allowed_direct_url_schemes     = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] api_rate_limit                 = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] auth_strategy                  = keystone {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_availability_zone      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_host                   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_name                   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_stats_polling_interval = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backup_api_class               = cinder.backup.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82558]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backup_name_template           = backup-%s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backup_use_same_host           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backup_use_temp_snapshot       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] chap_password                  = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] chap_username                  =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_internal_tenant_project_id = 3f7a6e1fd93947638fd47febb54c8021 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_internal_tenant_user_id = 58db37962f914b239dfa31960d5b9489 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cluster                        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] compression_format             = gzip {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] compute_api_class              = cinder.compute.nova.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] config_dir                     = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] config_source                  = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] control_exchange               = openstack {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] debug                          = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] default_availability_zone      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] default_group_type             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] default_volume_type            = QuobyteHD {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] disk_geometry                  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] driver_client_cert             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] driver_client_cert_key         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] driver_data_namespace          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] driver_ssl_cert_path           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] driver_ssl_cert_verify         = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] driver_use_ssl                 = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] enable_new_services            = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] enable_unsupported_driver      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] enabled_backends               = ['QuobyteHD'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] enforce_multipath_for_image_xfer = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] filter_function                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_api_insecure            = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_api_servers             = ['http://192.168.122.189/image'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_api_ssl_compression     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_ca_certificates_file    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_catalog_info            = image:glance:publicURL {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_certfile                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_keyfile                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_num_retries             = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance_request_timeout         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] goodness_function              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] graceful_shutdown_timeout      = 5 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] group_api_class                = cinder.group.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] host                           = devstack {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_compress_on_upload       = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_conversion_address_space_limit = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_conversion_cpu_limit     = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_conversion_disable       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_upload_use_cinder_backend = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_upload_use_internal_tenant = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_volume_cache_enabled     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_volume_cache_max_count   = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] image_volume_cache_max_size_gb = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] init_host_max_objects_retrieval = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] instance_format                = [instance: %(uuid)s]  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] iscsi_target_flags             =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] iscsi_write_cache              = on {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] iser_helper                    = tgtadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] iser_ip_address                = 192.168.122.189 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] iser_port                      = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_color                      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_config_append              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_dir                        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_file                       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_options                    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_rotate_interval            = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_rotate_interval_type       = days {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] log_rotation_type              = none {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] max_age                        = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] max_logfile_count              = 30 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] max_logfile_size_mb            = 200 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] max_over_subscription_ratio    = 20.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] message_reap_interval          = 86400 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] message_ttl                    = 2592000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] migration_create_volume_timeout_secs = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] monkey_patch                   = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] monkey_patch_modules           = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] my_ip                          = 192.168.122.189 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] no_snapshot_gb_quota           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] num_iser_scan_tries            = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] num_shell_tries                = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] num_volume_device_scan_tries   = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] nvmeof_conn_info_version       = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] nvmet_ns_id                    = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] nvmet_port_id                  = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_max_limit                = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_volume_ext_list          = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_volume_listen_port       = 8776 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_volume_use_ssl           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] osapi_volume_workers           = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] per_volume_size_limit          = -1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] periodic_fuzzy_delay           = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] periodic_interval              = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] public_endpoint                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] publish_errors                 = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_backup_gigabytes         = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_backups                  = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_gigabytes                = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_groups                   = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_snapshots                = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] quota_volumes                  = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] rate_limit_burst               = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] rate_limit_except_level        = CRITICAL {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] rate_limit_interval            = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] reinit_driver_count            = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] replication_device             = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] report_discard_supported       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] report_interval                = 120 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] reservation_clean_interval     = 86400 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] reservation_expire             = 86400 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] reserved_image_namespaces      = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] reserved_percentage            = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] rpc_response_timeout           = 120 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] run_external_periodic_tasks    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] scst_target_driver             = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] scst_target_iqn_name           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_down_time              = 720 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] shell_completion               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] snapshot_name_template         = snapshot-%s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] split_loggers                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] state_path                     = /opt/stack/data/cinder {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] storage_availability_zone      = nova {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] storage_protocol               = iSCSI {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] syslog_log_facility            = LOG_USER {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] target_helper                  = lioadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] target_ip_address              = 192.168.122.189 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] target_port                    = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] target_protocol                = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] target_secondary_ip_addresses  = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] trace_flags                    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] transport_url                  = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] until_refresh                  = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_chap_auth                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_default_quota_class        = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_journal                    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_json                       = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_multipath_for_image_xfer   = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_stderr                     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] use_syslog                     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] verify_glance_signatures       = enabled {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_api_class               = cinder.volume.api.API {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_backend_name            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_clear                   = zero {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_clear_ionice            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_clear_size              = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_copy_bps_limit          = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_dd_blocksize            = 1M {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_name_template           = volume-%s {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_service_inithost_offload = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volume_usage_audit_period      = month {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] zoning_mode                    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_concurrency.disable_process_locking = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.admin_password = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.admin_token = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.admin_user  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_port   = 35357 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_protocol = https {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_section = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_type   = password {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_uri    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.auth_version = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.cache       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.certfile    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.delay_auth_decision = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.http_connect_timeout = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.identity_uri = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.include_service_catalog = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.insecure    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.interface   = public {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.keyfile     = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_password =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcache_username =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.region_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.service_token_roles_required = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.service_type = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.token_cache_time = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.backend                  = dogpile.cache.null {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.backend_argument         = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.backend_expiration_time  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.config_prefix            = cache.oslo {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.debug_cache_backend      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.enable_retry_client      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.enable_socket_keepalive  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.enabled                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.enforce_fips_mode        = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.expiration_time          = 600 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.hashclient_retry_attempts = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_dead_retry      = 300 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_pool_maxsize    = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_sasl_enabled    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.password                 = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.proxies                  = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.redis_db                 = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.redis_sentinel_service_name = mymaster {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.redis_server             = localhost:6379 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.retry_attempts           = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.retry_delay              = 0.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.socket_keepalive_count   = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.socket_keepalive_idle    = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.socket_keepalive_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.remotefs [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82558) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.socket_timeout           = 1.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.tls_allowed_ciphers      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.tls_cafile               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.tls_certfile             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.tls_enabled              = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.tls_keyfile              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cache.username                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] coordination.backend_url       = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.asyncio_connection    = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.asyncio_slave_connection = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.backend               = sqlalchemy {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.connection            = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.connection_debug      = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.connection_parameters =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.connection_recycle_time = 3600 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.connection_trace      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.db_inc_retry_interval = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.db_max_retries        = 20 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.db_max_retry_interval = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.db_retry_interval     = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.max_overflow          = 50 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.max_pool_size         = 5 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.max_retries           = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.mysql_wsrep_sync_wait = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.pool_timeout          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.retry_interval        = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.slave_connection      = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.sqlite_synchronous    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.synchronous_reader    = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] database.use_db_reconnect      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.connection_string     = messaging:// {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.enabled               = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.es_doc_type           = notification {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.es_scroll_size        = 10000 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.es_scroll_time        = 2m {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.filter_error_trace    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.hmac_keys             = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.sentinel_service_name = mymaster {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.socket_timeout        = 0.1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.trace_requests        = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler.trace_sqlalchemy      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler_jaeger.process_tags   = {} {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler_jaeger.service_name_prefix = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] profiler_otlp.service_name_prefix = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.enforce_new_defaults = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: WARNING oslo_config.cfg [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.enforce_scope      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.policy_default_rule = default {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.policy_file        = policy.yaml {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.group          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.helper_command = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] privsep_osbrick.user           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.group         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.helper_command = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] cinder_sys_admin.user          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.auth_section      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.auth_type         = password {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.cafile            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.certfile          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.collect_timing    = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.insecure          = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.keyfile           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.send_service_user_token = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.split_loggers     = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] service_user.timeout           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.auth_section            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.auth_type               = password {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.certfile                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.collect_timing          = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.insecure                = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.keyfile                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.region_name             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.split_loggers           = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] glance.timeout                 = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.backend_availability_zone = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.chap_password = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.chap_username =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.disk_geometry = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.driver_client_cert = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.driver_client_cert_key = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.driver_data_namespace = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.driver_use_ssl = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.enable_unsupported_driver = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.extra_capabilities = {} {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.filter_function = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.goodness_function = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.iscsi_target_flags =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.iscsi_write_cache = on {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.iser_helper   = tgtadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.iser_port     = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_host      =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_login     = admin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_mount_options = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_password  = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_private_key =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_share_path =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.num_shell_tries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.nvmet_port_id = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_client_cfg = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.quobyte_volume_url = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.replication_device = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.report_discard_supported = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.reserved_percentage = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.scst_target_driver = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.scst_target_iqn_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.storage_protocol = iSCSI {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.target_helper = tgtadm {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.target_port   = 3260 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.target_protocol = iscsi {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.trace_flags   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.unique_fqdn_network = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.use_chap_auth = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_backend_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_clear  = zero {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_clear_ionice = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_clear_size = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_reports.file_event_handler = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_reports.log_dir           = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.backend_availability_zone = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.backend_host         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.chap_password        = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.chap_username        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.chiscsi_conf         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.disk_geometry        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.driver_client_cert   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.driver_client_cert_key = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.driver_data_namespace = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.driver_use_ssl       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.extra_capabilities   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.filter_function      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.goodness_function    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.iser_helper          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.iser_ip_address      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.iser_port            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.iser_target_prefix   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_host             = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_login            = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_mount_options    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_password         = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_private_key      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_share_path       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_ssh_port         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.num_shell_tries      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.nvmet_port_id        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.replication_device   = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.report_discard_supported = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.reserved_percentage  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.scst_target_driver   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.storage_protocol     = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.target_helper        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.target_ip_address    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.target_port          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.target_prefix        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.target_protocol      = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.trace_flags          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.use_chap_auth        = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_clear         = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_clear_size    = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] QuobyteHD.volumes_dir          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.ssl      = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_notifications.driver = [] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_notifications.retry = -1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] oslo_messaging_notifications.transport_url = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] key_manager.fixed_key          = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.barbican_api_version  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.barbican_endpoint     = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.barbican_endpoint_type = public {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.barbican_region_name  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.cafile                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.certfile              = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.collect_timing        = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.insecure              = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.keyfile               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.number_of_retries     = 60 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.retry_delay           = 1 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.send_service_user_token = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.split_loggers         = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.timeout               = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.verify_ssl            = True {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican.verify_ssl_path       = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.auth_section = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.auth_type = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.cafile   = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.certfile = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.collect_timing = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.insecure = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.keyfile  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.split_loggers = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] barbican_service_user.timeout  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.approle_role_id          = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.approle_secret_id        = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.kv_mountpoint            = secret {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.kv_path                  = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.kv_version               = 2 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.namespace                = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.root_token_id            = **** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.ssl_ca_crt_file          = None {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.timeout                  = 60.0 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.use_ssl                  = False {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:30 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] ******************************************************************************** {{(pid=82441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 14:33:30 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82558) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 14:33:30 devstack cinder-volume[82558]: WARNING cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 14:33:30 devstack cinder-volume[82558]: WARNING cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 14:33:30 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Running cmd (subprocess): mount.quobyte {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:30 devstack quobyte-client[82559]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 14:33:30 devstack quobyte-client[82559]: Invalid parameters found, error: missing mount point.
Apr 15 14:33:30 devstack quobyte-client[82559]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 14:33:30 devstack quobyte-client[82559]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 14:33:30 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:30 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=82558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:31 devstack cinder-volume[82558]: INFO cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b ...
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba -c /etc/quobyte/client-cinder.cfg {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:31 devstack sudo[82560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba -c /etc/quobyte/client-cinder.cfg
Apr 15 14:33:31 devstack sudo[82560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:31 devstack sudo[82560]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.517s {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:31 devstack cinder-volume[82558]: INFO cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b succeeded
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=82558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.524s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:31 devstack sudo[82630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:31 devstack sudo[82630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:31 devstack sudo[82630]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.402s {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:31 devstack cinder-volume[82558]: INFO cinder.volume.driver [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG cinder.volume.driver [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6874732971191, 'free_capacity_gb': 1775.6874732971191, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82558) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_db.sqlalchemy.engines [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82558) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG dbcounter [-] [82558] Writer thread running {{(pid=82558) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG cinder.db.sqlalchemy.api [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Building query based on filter {{(pid=82558) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG cinder.image.image_utils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82558) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 14:33:31 devstack cinder-volume[82558]: INFO cinder.keymgr.migration [None req-f99cf59c-cf4e-4001-b226-0d562de588c2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:31 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=82558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=82558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:32 devstack sudo[82633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:32 devstack sudo[82633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:32 devstack sudo[82633]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.389s {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG cinder.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Notifying Schedulers of capabilities ... {{(pid=82558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:33:32 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Driver initialization completed successfully.
Apr 15 14:33:32 devstack cinder-volume[82558]: INFO cinder.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Initiating service 3 cleanup
Apr 15 14:33:32 devstack cinder-volume[82558]: INFO cinder.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Service 3 cleanup completed.
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG cinder.service [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Creating RPC server for service cinder-volume {{(pid=82558) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG cinder.service [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82558) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 14:33:32 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=82558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=82558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:32 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:32 devstack sudo[82663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:32 devstack sudo[82663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:33 devstack sudo[82663]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:33 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.673s {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:33 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-2289d7f1-7170-454f-9829-8defe84236ba None None] Driver post RPC initialization completed successfully.
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=82558) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG cinder.volume.drivers.quobyte [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=82558) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82558) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:35 devstack sudo[82704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:35 devstack sudo[82704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:35 devstack sudo[82704]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG oslo_concurrency.processutils [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.399s {{(pid=82558) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:35 devstack cinder-volume[82558]: DEBUG cinder.manager [None req-e73ffe08-db1a-4533-a694-6c1c1575e751 None None] Notifying Schedulers of capabilities ... {{(pid=82558) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:33:38 devstack cinder-volume[82441]: INFO oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Caught SIGTERM, stopping children
Apr 15 14:33:38 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Acquiring lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:33:38 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Acquired lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:33:38 devstack cinder-volume[82441]: DEBUG oslo_concurrency.lockutils [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Releasing lock "singleton_lock" {{(pid=82441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:33:38 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Stop services. {{(pid=82441) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 15 14:33:38 devstack cinder-volume[82441]: DEBUG oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Killing children. {{(pid=82441) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 15 14:33:38 devstack cinder-volume[82441]: INFO oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Waiting on 1 children to exit
Apr 15 14:33:40 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Acquiring lock "singleton_lock" {{(pid=82558) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:33:40 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Acquired lock "singleton_lock" {{(pid=82558) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:33:40 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Releasing lock "singleton_lock" {{(pid=82558) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:33:40 devstack cinder-volume[82558]: WARNING amqp [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 14:33:40 devstack cinder-volume[82558]: WARNING amqp [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 15 14:33:40 devstack cinder-volume[82441]: INFO oslo_service.backend._eventlet.service [None req-891756e4-8efe-40f3-989f-65e77d97563f None None] Child 82558 exited with status 0
Apr 15 14:33:41 devstack cinder-volume[82793]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 15 14:33:41 devstack cinder-volume[82793]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 14:33:41 devstack cinder-volume[82793]: we strongly recommend against using it for new projects.
Apr 15 14:33:41 devstack cinder-volume[82793]: If you are already using Eventlet, we recommend migrating to a different
Apr 15 14:33:41 devstack cinder-volume[82793]: framework.  For more detail see
Apr 15 14:33:41 devstack cinder-volume[82793]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 14:33:41 devstack cinder-volume[82793]:   import eventlet  # noqa
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 15 14:33:43 devstack cinder-volume[82793]: INFO dbcounter [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Registered counter for database cinder
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_db.sqlalchemy.engines [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG dbcounter [-] [82793] Writer thread running {{(pid=82793) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 14:33:43 devstack cinder-volume[82793]: INFO cinder.rpc [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 15 14:33:43 devstack cinder-volume[82793]: INFO cinder.rpc [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_db.sqlalchemy.engines [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:43 devstack cinder-volume[82793]: INFO cinder.volume.manager [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Determined volume DB was empty at startup.
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG cinder.volume.manager [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82793) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 15 14:33:43 devstack cinder-volume[82793]: WARNING stevedore.named [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 15 14:33:43 devstack cinder-volume[82793]: WARNING castellan.key_manager [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:33:43 devstack cinder-volume[82793]: WARNING cinder.keymgr.conf_key_mgr [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 15 14:33:43 devstack cinder-volume[82793]: INFO cinder.volume.manager [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_db.sqlalchemy.engines [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:43 devstack cinder-volume[82793]: INFO oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Starting 1 workers
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Started child 83037 {{(pid=82793) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Full set of CONF: {{(pid=82793) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] ******************************************************************************** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 15 14:33:43 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Configuration options gathered from: {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] ================================================================================ {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] allow_availability_zone_fallback = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] allow_compression_on_image_upload = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] allowed_direct_url_schemes     = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] api_rate_limit                 = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] auth_strategy                  = keystone {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_availability_zone      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_host                   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_name                   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_stats_polling_interval = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backup_api_class               = cinder.backup.api.API {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[83037]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backup_name_template           = backup-%s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backup_use_same_host           = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backup_use_temp_snapshot       = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] chap_password                  = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] chap_username                  =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_internal_tenant_project_id = 3f7a6e1fd93947638fd47febb54c8021 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_internal_tenant_user_id = 58db37962f914b239dfa31960d5b9489 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cluster                        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] compression_format             = gzip {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] compute_api_class              = cinder.compute.nova.API {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] config_dir                     = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] config_source                  = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] control_exchange               = openstack {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] debug                          = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] default_availability_zone      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] default_group_type             = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] default_volume_type            = QuobyteHD {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] disk_geometry                  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] driver_client_cert             = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] driver_client_cert_key         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] driver_data_namespace          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] driver_ssl_cert_path           = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] driver_ssl_cert_verify         = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] driver_use_ssl                 = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] enable_new_services            = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] enable_unsupported_driver      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] enabled_backends               = ['QuobyteHD'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] enforce_multipath_for_image_xfer = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] filter_function                = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_api_insecure            = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_api_servers             = ['http://192.168.122.189/image'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_api_ssl_compression     = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_ca_certificates_file    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_catalog_info            = image:glance:publicURL {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_certfile                = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_keyfile                 = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_num_retries             = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance_request_timeout         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] goodness_function              = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] graceful_shutdown_timeout      = 5 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] group_api_class                = cinder.group.api.API {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] host                           = devstack {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_compress_on_upload       = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_conversion_address_space_limit = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_conversion_cpu_limit     = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_conversion_disable       = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_upload_use_cinder_backend = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_upload_use_internal_tenant = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_volume_cache_enabled     = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_volume_cache_max_count   = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] image_volume_cache_max_size_gb = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] init_host_max_objects_retrieval = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] instance_format                = [instance: %(uuid)s]  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] iscsi_target_flags             =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] iscsi_write_cache              = on {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] iser_helper                    = tgtadm {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] iser_ip_address                = 192.168.122.189 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] iser_port                      = 3260 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_color                      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_config_append              = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_dir                        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_file                       = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_options                    = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_rotate_interval            = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_rotate_interval_type       = days {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] log_rotation_type              = none {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] max_age                        = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] max_logfile_count              = 30 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] max_logfile_size_mb            = 200 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] max_over_subscription_ratio    = 20.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] message_reap_interval          = 86400 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] message_ttl                    = 2592000 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] migration_create_volume_timeout_secs = 300 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] monkey_patch                   = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] monkey_patch_modules           = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] my_ip                          = 192.168.122.189 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] no_snapshot_gb_quota           = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] num_iser_scan_tries            = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] num_shell_tries                = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] num_volume_device_scan_tries   = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] nvmeof_conn_info_version       = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] nvmet_ns_id                    = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] nvmet_port_id                  = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_max_limit                = 1000 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_volume_ext_list          = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_volume_listen_port       = 8776 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83037) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_volume_use_ssl           = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] osapi_volume_workers           = 2 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] per_volume_size_limit          = -1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] periodic_fuzzy_delay           = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] periodic_interval              = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] public_endpoint                = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] publish_errors                 = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_backup_gigabytes         = 1000 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_backups                  = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_gigabytes                = 1000 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_groups                   = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_snapshots                = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] quota_volumes                  = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] rate_limit_burst               = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] rate_limit_except_level        = CRITICAL {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] rate_limit_interval            = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] reinit_driver_count            = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] replication_device             = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] report_discard_supported       = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] report_interval                = 120 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] reservation_clean_interval     = 86400 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] reservation_expire             = 86400 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] reserved_image_namespaces      = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] reserved_percentage            = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] rpc_response_timeout           = 120 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] run_external_periodic_tasks    = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] scst_target_driver             = iscsi {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] scst_target_iqn_name           = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_down_time              = 720 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] shell_completion               = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] snapshot_name_template         = snapshot-%s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] split_loggers                  = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] state_path                     = /opt/stack/data/cinder {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] storage_availability_zone      = nova {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] storage_protocol               = iSCSI {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] syslog_log_facility            = LOG_USER {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] target_helper                  = lioadm {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] target_ip_address              = 192.168.122.189 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] target_port                    = 3260 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] target_protocol                = iscsi {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] target_secondary_ip_addresses  = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] trace_flags                    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] transport_url                  = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] until_refresh                  = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_chap_auth                  = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_default_quota_class        = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_journal                    = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_json                       = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_multipath_for_image_xfer   = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_stderr                     = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] use_syslog                     = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] verify_glance_signatures       = enabled {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_api_class               = cinder.volume.api.API {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_backend_name            = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_clear                   = zero {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_clear_ionice            = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_clear_size              = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_copy_bps_limit          = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_dd_blocksize            = 1M {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_name_template           = volume-%s {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_service_inithost_offload = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volume_usage_audit_period      = month {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] zoning_mode                    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_concurrency.disable_process_locking = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.admin_password = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.admin_token = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.admin_user  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_port   = 35357 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_protocol = https {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_section = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_type   = password {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_uri    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.auth_version = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.cache       = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.certfile    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.delay_auth_decision = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.http_connect_timeout = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.identity_uri = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.include_service_catalog = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.insecure    = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.interface   = public {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.keyfile     = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_password =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcache_username =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.region_name = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.service_token_roles_required = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.service_type = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.token_cache_time = 300 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.backend                  = dogpile.cache.null {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.backend_argument         = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.backend_expiration_time  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.config_prefix            = cache.oslo {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.debug_cache_backend      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.enable_retry_client      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.enable_socket_keepalive  = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.enabled                  = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.enforce_fips_mode        = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.expiration_time          = 600 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.hashclient_retry_attempts = 2 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_dead_retry      = 300 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_pool_maxsize    = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_sasl_enabled    = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.password                 = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.proxies                  = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.redis_db                 = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.redis_sentinel_service_name = mymaster {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.redis_server             = localhost:6379 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.retry_attempts           = 2 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.retry_delay              = 0.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.socket_keepalive_count   = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.socket_keepalive_idle    = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.socket_keepalive_interval = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.socket_timeout           = 1.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.tls_allowed_ciphers      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.tls_cafile               = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.tls_certfile             = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.tls_enabled              = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.tls_keyfile              = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cache.username                 = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] coordination.backend_url       = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.asyncio_connection    = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.asyncio_slave_connection = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.backend               = sqlalchemy {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.connection            = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.connection_debug      = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.connection_parameters =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.connection_recycle_time = 3600 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.connection_trace      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.db_inc_retry_interval = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.db_max_retries        = 20 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.db_max_retry_interval = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.db_retry_interval     = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.max_overflow          = 50 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.max_pool_size         = 5 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.max_retries           = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.mysql_wsrep_sync_wait = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.pool_timeout          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.retry_interval        = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.slave_connection      = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.sqlite_synchronous    = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.synchronous_reader    = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] database.use_db_reconnect      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.connection_string     = messaging:// {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.enabled               = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.es_doc_type           = notification {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.es_scroll_size        = 10000 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.es_scroll_time        = 2m {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.filter_error_trace    = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.hmac_keys             = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.sentinel_service_name = mymaster {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.socket_timeout        = 0.1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.trace_requests        = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler.trace_sqlalchemy      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler_jaeger.process_tags   = {} {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler_jaeger.service_name_prefix = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] profiler_otlp.service_name_prefix = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.enforce_new_defaults = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: WARNING oslo_config.cfg [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.enforce_scope      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.policy_default_rule = default {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.policy_file        = policy.yaml {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.group          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.helper_command = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] privsep_osbrick.user           = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.group         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.helper_command = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] cinder_sys_admin.user          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.auth_section      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.auth_type         = password {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.cafile            = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.certfile          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.collect_timing    = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.insecure          = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.keyfile           = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.send_service_user_token = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.split_loggers     = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] service_user.timeout           = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.auth_section            = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.auth_type               = password {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.certfile                = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.collect_timing          = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.insecure                = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.keyfile                 = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.region_name             = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.split_loggers           = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] glance.timeout                 = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.backend_availability_zone = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.chap_password = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.chap_username =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.disk_geometry = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.driver_client_cert = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.driver_client_cert_key = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83037) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.driver_data_namespace = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.driver_use_ssl = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.enable_unsupported_driver = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.extra_capabilities = {} {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.filter_function = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.goodness_function = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Running cmd (subprocess): mount.quobyte {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.iscsi_target_flags =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.iscsi_write_cache = on {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.iser_helper   = tgtadm {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.iser_port     = 3260 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_host      =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_login     = admin {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_mount_options = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_password  = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_private_key =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_share_path =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.num_shell_tries = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.nvmet_port_id = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_client_cfg = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.quobyte_volume_url = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.replication_device = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.report_discard_supported = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.reserved_percentage = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.scst_target_driver = iscsi {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.scst_target_iqn_name = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.storage_protocol = iSCSI {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.target_helper = tgtadm {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.target_port   = 3260 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.target_protocol = iscsi {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.trace_flags   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.unique_fqdn_network = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.use_chap_auth = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_backend_name = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_clear  = zero {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_clear_ionice = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_clear_size = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_reports.file_event_handler = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_reports.log_dir           = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.backend_availability_zone = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.backend_host         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.chap_password        = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.chap_username        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.chiscsi_conf         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.disk_geometry        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.driver_client_cert   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.driver_client_cert_key = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.driver_data_namespace = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.driver_use_ssl       = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.extra_capabilities   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.filter_function      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.goodness_function    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.iser_helper          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.iser_ip_address      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.iser_port            = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.iser_target_prefix   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_host             = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_login            = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_mount_options    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_password         = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_private_key      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_share_path       = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_ssh_port         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.num_shell_tries      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.nvmet_port_id        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.replication_device   = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.report_discard_supported = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.reserved_percentage  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.scst_target_driver   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.storage_protocol     = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.target_helper        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.target_ip_address    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.target_port          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.target_prefix        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.target_protocol      = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.trace_flags          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.use_chap_auth        = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_clear         = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_clear_size    = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] QuobyteHD.volumes_dir          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.ssl      = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_notifications.driver = [] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_notifications.retry = -1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] oslo_messaging_notifications.transport_url = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] key_manager.fixed_key          = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.barbican_api_version  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.barbican_endpoint     = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.barbican_endpoint_type = public {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.barbican_region_name  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.cafile                = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.certfile              = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.collect_timing        = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.insecure              = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.keyfile               = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.number_of_retries     = 60 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.retry_delay           = 1 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.send_service_user_token = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.split_loggers         = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.timeout               = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.verify_ssl            = True {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican.verify_ssl_path       = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.auth_section = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.auth_type = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.cafile   = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.certfile = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.collect_timing = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.insecure = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.keyfile  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.split_loggers = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] barbican_service_user.timeout  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.approle_role_id          = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.approle_secret_id        = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.kv_mountpoint            = secret {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.kv_path                  = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.kv_version               = 2 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.namespace                = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.root_token_id            = **** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.ssl_ca_crt_file          = None {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.timeout                  = 60.0 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.use_ssl                  = False {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 15 14:33:44 devstack cinder-volume[82793]: DEBUG oslo_service.backend._eventlet.service [None req-1df0f569-12b8-47fc-aabc-0a5102831a4b None None] ******************************************************************************** {{(pid=82793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 15 14:33:44 devstack quobyte-client[83049]: Reading configuration file: /etc/quobyte/client.cfg
Apr 15 14:33:44 devstack quobyte-client[83049]: Invalid parameters found, error: missing mount point.
Apr 15 14:33:44 devstack quobyte-client[83049]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 15 14:33:44 devstack quobyte-client[83049]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:44 devstack sudo[83050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:44 devstack sudo[83050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:44 devstack sudo[83050]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.402s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:44 devstack cinder-volume[83037]: INFO cinder.volume.driver [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Driver hasn't implemented _init_vendor_properties()
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.driver [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6866645812988, 'free_capacity_gb': 1775.6866645812988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83037) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_db.sqlalchemy.engines [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writer thread running {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.db.sqlalchemy.api [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Building query based on filter {{(pid=83037) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83037) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:44 devstack cinder-volume[83037]: INFO cinder.keymgr.migration [None req-173781d2-1ecd-43b4-bfa9-9f2e9549e5b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 15 14:33:44 devstack sudo[83066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:44 devstack sudo[83066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:45 devstack sudo[83066]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.378s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:33:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Driver initialization completed successfully.
Apr 15 14:33:45 devstack cinder-volume[83037]: INFO cinder.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Initiating service 3 cleanup
Apr 15 14:33:45 devstack cinder-volume[83037]: INFO cinder.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Service 3 cleanup completed.
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG cinder.service [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Creating RPC server for service cinder-volume {{(pid=83037) start /opt/stack/cinder/cinder/service.py:231}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG cinder.service [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83037) start /opt/stack/cinder/cinder/service.py:237}}
Apr 15 14:33:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:33:45 devstack sudo[83069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:33:45 devstack sudo[83069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:33:45 devstack sudo[83069]: pam_unix(sudo:session): session closed for user root
Apr 15 14:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.431s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:33:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2412c052-ce36-4397-aca4-e034669a0e9f None None] Driver post RPC initialization completed successfully.
Apr 15 14:33:53 devstack cinder-volume[82793]: DEBUG dbcounter [-] [82793] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82793) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:33:55 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=2 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:33:55 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Flow 'volume_create_manager' (42e51148-37df-4121-956a-4cc08f92f125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05279487-b3fa-4686-89e8-ddddff6a610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05279487-b3fa-4686-89e8-ddddff6a610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1869959424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d65d56-0afc-442c-b260-0dbc4c3fdcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95819ba66b0349639aaabceb888c5a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:45Z,use_quota=True,user_id='531bad202971413eb3a2c74c73254791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc79a98-f764-497d-a039-736e659ec522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc79a98-f764-497d-a039-736e659ec522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8420807-4e5d-43f0-89a7-e0336b8379dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8420807-4e5d-43f0-89a7-e0336b8379dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d65d56-0afc-442c-b260-0dbc4c3fdcd9', 'volume_name': 'volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6df86b3-7ee0-415f-a596-15bc08794d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6df86b3-7ee0-415f-a596-15bc08794d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c382ddb-a571-4e23-939f-a801cf7f4312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Volume 50d65d56-0afc-442c-b260-0dbc4c3fdcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9', 'volume_size': 1}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1869959424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d65d56-0afc-442c-b260-0dbc4c3fdcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95819ba66b0349639aaabceb888c5a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:45Z,use_quota=True,user_id='531bad202971413eb3a2c74c73254791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Creating volume 50d65d56-0afc-442c-b260-0dbc4c3fdcd9 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:34:45 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:45 devstack sudo[83537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 1073741824
Apr 15 14:34:45 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Flow 'volume_create_manager' (18f17ae3-c329-40c7-aca0-7cec94752e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c167f8-d767-40a5-a340-18f610b40394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c167f8-d767-40a5-a340-18f610b40394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2118882421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4444db05-1f8b-4f7b-a351-e4f65e5ec25c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d6f89ac8274c72b6a9360cefb3487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:45Z,use_quota=True,user_id='423a5547938448dab7b3ff710827605a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d7818c-3f20-4d13-b2df-1ed6281640e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d7818c-3f20-4d13-b2df-1ed6281640e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08595c96-c11c-4908-bdea-e53dfaa55d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08595c96-c11c-4908-bdea-e53dfaa55d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4444db05-1f8b-4f7b-a351-e4f65e5ec25c', 'volume_name': 'volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c1df1f-03d4-4e89-a819-430e30d80795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c1df1f-03d4-4e89-a819-430e30d80795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63338bc0-b7a9-46c3-be85-6b209600e6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Volume 4444db05-1f8b-4f7b-a351-e4f65e5ec25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c', 'volume_size': 1}
Apr 15 14:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:46 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 1073741824" returned: 0 in 1.075s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:47 devstack sudo[83861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9
Apr 15 14:34:47 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:47 devstack sudo[83869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:34:47 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:48 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" returned: 0 in 1.533s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] <== create_volume: return (2684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.687s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.581s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2118882421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4444db05-1f8b-4f7b-a351-e4f65e5ec25c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d6f89ac8274c72b6a9360cefb3487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:45Z,use_quota=True,user_id='423a5547938448dab7b3ff710827605a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Creating volume 4444db05-1f8b-4f7b-a351-e4f65e5ec25c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:34:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:48 devstack sudo[83883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c 1073741824
Apr 15 14:34:48 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c382ddb-a571-4e23-939f-a801cf7f4312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c8916-f0d3-4341-bd40-456dfafcee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Flow 'volume_create_manager' (5afe9939-2a74-4c56-8ce1-c5ba424f585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69065881-41f5-48bd-8d2b-f40904936ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Volume volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 (50d65d56-0afc-442c-b260-0dbc4c3fdcd9): created successfully
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c8916-f0d3-4341-bd40-456dfafcee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Flow 'volume_create_manager' (42e51148-37df-4121-956a-4cc08f92f125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69065881-41f5-48bd-8d2b-f40904936ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-536473490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5c7b2e-f9d3-41d0-9b7c-12f96e111703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdd203da46449bca29a4d62412cdae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:48Z,use_quota=True,user_id='2a9aea28d9a84328b3c7eec753c90ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa798f90-ed2b-4e6c-afe3-b54c26e8a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa798f90-ed2b-4e6c-afe3-b54c26e8a164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155230ff-463a-4357-8490-7be61e1f7db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155230ff-463a-4357-8490-7be61e1f7db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5c7b2e-f9d3-41d0-9b7c-12f96e111703', 'volume_name': 'volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5b46a2-4eb0-4fef-88ae-daa93a6b9681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5b46a2-4eb0-4fef-88ae-daa93a6b9681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8577a94-702d-43f0-92f2-8e293edef9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Volume 3b5c7b2e-f9d3-41d0-9b7c-12f96e111703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703', 'volume_size': 1}
Apr 15 14:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c8611bd1-1b7b-43be-aca2-2480c643a818 tempest-DeleteServersTestJSON-736138816 None] Created volume successfully.
Apr 15 14:34:49 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.645s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:49 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:34:49 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c 1073741824" returned: 0 in 1.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:49 devstack sudo[83900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c
Apr 15 14:34:49 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:50 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c" returned: 0 in 0.859s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-536473490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5c7b2e-f9d3-41d0-9b7c-12f96e111703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdd203da46449bca29a4d62412cdae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:48Z,use_quota=True,user_id='2a9aea28d9a84328b3c7eec753c90ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Creating volume 3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:34:50 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63338bc0-b7a9-46c3-be85-6b209600e6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4674d23-4e3a-432f-aa06-dcd6afe586b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:50 devstack sudo[83903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 1073741824
Apr 15 14:34:50 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Volume volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c (4444db05-1f8b-4f7b-a351-e4f65e5ec25c): created successfully
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4674d23-4e3a-432f-aa06-dcd6afe586b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Flow 'volume_create_manager' (18f17ae3-c329-40c7-aca0-7cec94752e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-91e59c34-61b4-48c9-af14-62b6dd1dcf30 tempest-VolumesTestJSON-1307794457 None] Created volume successfully.
Apr 15 14:34:52 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 1073741824" returned: 0 in 1.573s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:52 devstack sudo[83941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703
Apr 15 14:34:52 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:53 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703" returned: 0 in 1.091s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.697s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8577a94-702d-43f0-92f2-8e293edef9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ac066d-6bc6-41fa-9f67-786afcde71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Volume volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 (3b5c7b2e-f9d3-41d0-9b7c-12f96e111703): created successfully
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ac066d-6bc6-41fa-9f67-786afcde71d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Flow 'volume_create_manager' (5afe9939-2a74-4c56-8ce1-c5ba424f585b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-48f1488b-e393-4c4d-9a2e-291b395870ae tempest-VolumesAdminNegativeTest-1355474801 None] Created volume successfully.
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Flow 'volume_create_manager' (a4fa2c1b-7529-441a-bdd4-270158a52540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89302cd2-786f-4ce5-8831-434ed1d3b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89302cd2-786f-4ce5-8831-434ed1d3b670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303647143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d9cf41-41da-4d68-b0d8-b391fbe868b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d6f89ac8274c72b6a9360cefb3487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:54Z,use_quota=True,user_id='423a5547938448dab7b3ff710827605a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5b4595-49c7-4d8c-a078-2cec057e9400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5b4595-49c7-4d8c-a078-2cec057e9400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b6196d-031d-4150-8b34-24d4731103c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b6196d-031d-4150-8b34-24d4731103c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d9cf41-41da-4d68-b0d8-b391fbe868b7', 'volume_name': 'volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080eeda6-c427-41cc-80a0-b5a93353b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080eeda6-c427-41cc-80a0-b5a93353b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4834f6bc-f7f2-41f0-a002-6157eb19f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Volume 44d9cf41-41da-4d68-b0d8-b391fbe868b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7', 'volume_size': 1}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303647143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d9cf41-41da-4d68-b0d8-b391fbe868b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d6f89ac8274c72b6a9360cefb3487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:54Z,use_quota=True,user_id='423a5547938448dab7b3ff710827605a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Creating volume 44d9cf41-41da-4d68-b0d8-b391fbe868b7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:34:53 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:34:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:54 devstack sudo[83975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 1073741824
Apr 15 14:34:54 devstack sudo[83975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Acquiring lock "cinder-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:34:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Lock "cinder-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:34:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Acquiring lock "cinder-quobyte-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:34:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Lock "cinder-quobyte-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:34:55 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvjsz1yci/privsep.sock']
Apr 15 14:34:55 devstack sudo[83981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvjsz1yci/privsep.sock
Apr 15 14:34:55 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 14:34:55 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 15 14:34:56 devstack sudo[83975]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 1073741824" returned: 0 in 2.182s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:56 devstack sudo[83991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7
Apr 15 14:34:56 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 15 14:34:56 devstack cinder-volume[83037]: WARNING py.warnings [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 15 14:34:56 devstack cinder-volume[83037]:   .first()
Apr 15 14:34:56 devstack cinder-volume[83037]: 
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:56 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7" returned: 0 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] <== create_volume: return (2763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.769s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.038s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4834f6bc-f7f2-41f0-a002-6157eb19f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64d7d04-0e9f-4d13-af12-a76194cf4978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:56 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Volume volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 (44d9cf41-41da-4d68-b0d8-b391fbe868b7): created successfully
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64d7d04-0e9f-4d13-af12-a76194cf4978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Flow 'volume_create_manager' (a4fa2c1b-7529-441a-bdd4-270158a52540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c689e3c4-9d20-466a-bc4b-7e122dfaa615 tempest-VolumesTestJSON-1307794457 None] Created volume successfully.
Apr 15 14:34:57 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:57 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Spawned new privsep daemon via rootwrap
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Accepted privsep connection to /tmp/tmpvjsz1yci/privsep.sock {{(pid=83037) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 15 14:34:57 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 15 14:34:57 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 15 14:34:57 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 15 14:34:57 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84004
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed85a841-9bb1-4696-a7cb-6024536408fd]: (2,) {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:34:57 devstack cinder-volume[83037]: WARNING oslo_privsep.priv_context [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] privsep daemon already running
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9e63f-6f12-4fec-9230-3797d96b8b0f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[be16ffc9-57a6-44b0-ae72-0185d8491c03]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:57 devstack sudo[84008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703
Apr 15 14:34:57 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:57 devstack sudo[84009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9
Apr 15 14:34:57 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Flow 'volume_create_manager' (505add53-ccd4-425a-acde-8035789977db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623d547a-6615-4eb7-a9bc-2aaccaec2ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623d547a-6615-4eb7-a9bc-2aaccaec2ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-912712351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63102520-452a-47a3-94cf-e975320836f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d6f89ac8274c72b6a9360cefb3487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:58Z,use_quota=True,user_id='423a5547938448dab7b3ff710827605a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e29cdf-83cc-4aa5-878f-3507b39a71af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e29cdf-83cc-4aa5-878f-3507b39a71af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a994c2-6b94-4597-9d37-58768db36a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a994c2-6b94-4597-9d37-58768db36a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63102520-452a-47a3-94cf-e975320836f4', 'volume_name': 'volume-63102520-452a-47a3-94cf-e975320836f4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28baf21-139a-49e7-8100-a8eca665758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28baf21-139a-49e7-8100-a8eca665758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b362cf23-2365-4fc0-9129-7611c25c617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:34:57 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Volume 63102520-452a-47a3-94cf-e975320836f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63102520-452a-47a3-94cf-e975320836f4', 'volume_size': 1}
Apr 15 14:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:58 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" returned: 0 in 1.169s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.665s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-912712351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63102520-452a-47a3-94cf-e975320836f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d6f89ac8274c72b6a9360cefb3487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:34:58Z,use_quota=True,user_id='423a5547938448dab7b3ff710827605a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Creating volume 63102520-452a-47a3-94cf-e975320836f4 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:58 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:34:58 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:58 devstack sudo[84020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4 1073741824
Apr 15 14:34:58 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703" returned: 0 in 1.329s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:58 devstack sudo[84022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703
Apr 15 14:34:58 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b', 'name': 'volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e50a5c2-15aa-4285-996c-c8e7758ddea7', 'enforce_multipath': True} {{(pid=83037) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 14:34:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-4c3025e6-3ecc-4ef5-b6b3-d5bb814e52e2 req-88801630-5aeb-4665-82c3-4d6410d3d5f0 tempest-DeleteServersTestJSON-736138816 None] attachment_update completed successfully.
Apr 15 14:34:59 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703" returned: 0 in 0.942s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Lock "cinder-quobyte-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703" released by "delete_volume" :: held 4.536s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:34:59 devstack cinder-volume[83037]: WARNING cinder.quota [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:34:59 devstack cinder-volume[83037]: WARNING cinder.quota [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Created reservations ['ab845f8d-4a8d-4485-8dde-412e47fe9ea4', 'fc86d0f1-4082-4fb1-bcf9-7bed11afc58b', '1524bc4a-09bf-445b-93d8-57e650364b65', '59c5000d-9d13-487a-b599-e9b02a97bcf4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:59 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4 1073741824" returned: 0 in 1.427s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:34:59 devstack sudo[84030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:34:59 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:34:59 devstack sudo[84032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4
Apr 15 14:34:59 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:00 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4" returned: 0 in 0.714s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b362cf23-2365-4fc0-9129-7611c25c617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63102520-452a-47a3-94cf-e975320836f4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d4bd34-f9c7-44ef-8317-b036a80e153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:00 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Volume volume-63102520-452a-47a3-94cf-e975320836f4 (63102520-452a-47a3-94cf-e975320836f4): created successfully
Apr 15 14:35:00 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d4bd34-f9c7-44ef-8317-b036a80e153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Flow 'volume_create_manager' (505add53-ccd4-425a-acde-8035789977db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.877s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Deleted volume successfully.
Apr 15 14:35:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-74006913-a390-407d-8a5a-69d9ea413e2b tempest-VolumesTestJSON-1307794457 None] Created volume successfully.
Apr 15 14:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2079e72b-5f68-44c7-8f08-a5a6b15733a4 tempest-VolumesAdminNegativeTest-1355474801 None] Lock "cinder-3b5c7b2e-f9d3-41d0-9b7c-12f96e111703-delete_volume" released by "delete_volume" :: held 5.847s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Acquiring lock "cinder-63102520-452a-47a3-94cf-e975320836f4-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Lock "cinder-63102520-452a-47a3-94cf-e975320836f4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Acquiring lock "cinder-quobyte-63102520-452a-47a3-94cf-e975320836f4" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Lock "cinder-quobyte-63102520-452a-47a3-94cf-e975320836f4" acquired by "delete_volume" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e27655-674c-46ac-9904-df8ca716429c]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:02 devstack sudo[84473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4
Apr 15 14:35:02 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:03 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4" returned: 0 in 0.762s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:03 devstack sudo[84485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4
Apr 15 14:35:03 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:04 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-63102520-452a-47a3-94cf-e975320836f4" returned: 0 in 0.836s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Lock "cinder-quobyte-63102520-452a-47a3-94cf-e975320836f4" released by "delete_volume" :: held 1.631s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Created reservations ['c91165c1-d0d2-4951-b7d8-2e8dc45c4f10', 'fcfd732f-17b2-47e5-9876-d155ebd0ff05', '15787f43-1184-44e4-8bc6-0bcaf518cfe5', '3fdca6e5-0591-49bd-b9fc-bd84ca598258'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:04 devstack sudo[84497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:04 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Acquiring lock "cinder-44d9cf41-41da-4d68-b0d8-b391fbe868b7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Lock "cinder-44d9cf41-41da-4d68-b0d8-b391fbe868b7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:04 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Acquiring lock "cinder-quobyte-44d9cf41-41da-4d68-b0d8-b391fbe868b7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Deleted volume successfully.
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Lock "cinder-quobyte-44d9cf41-41da-4d68-b0d8-b391fbe868b7" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f5b74-b861-42db-b6ab-1b85bfe6b8c4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9f7cd99-08e2-4a5e-81e5-1c702022a0ee tempest-VolumesTestJSON-1307794457 None] Lock "cinder-63102520-452a-47a3-94cf-e975320836f4-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:04 devstack sudo[84502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7
Apr 15 14:35:04 devstack sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:05 devstack sudo[84502]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:05 devstack sudo[84507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7
Apr 15 14:35:05 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:05 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-44d9cf41-41da-4d68-b0d8-b391fbe868b7" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Lock "cinder-quobyte-44d9cf41-41da-4d68-b0d8-b391fbe868b7" released by "delete_volume" :: held 1.054s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Created reservations ['d089296b-c69f-458e-bf2a-841f962d0d2d', '8a9898bb-0fd6-4f1e-8320-bef053eafbef', '6589c3f2-f787-4755-abdb-ac42fe9baaa6', 'eb1240e1-5356-4483-81e9-d9050bb9ff85'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:05 devstack sudo[84541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:05 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:06 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.562s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Deleted volume successfully.
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99db2332-a41f-47fa-89c3-05b8a224468b tempest-VolumesTestJSON-1307794457 None] Lock "cinder-44d9cf41-41da-4d68-b0d8-b391fbe868b7-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Acquiring lock "cinder-4444db05-1f8b-4f7b-a351-e4f65e5ec25c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Lock "cinder-4444db05-1f8b-4f7b-a351-e4f65e5ec25c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Acquiring lock "cinder-quobyte-4444db05-1f8b-4f7b-a351-e4f65e5ec25c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Lock "cinder-quobyte-4444db05-1f8b-4f7b-a351-e4f65e5ec25c" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9866dc-c39a-4a12-8657-789ed569587b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:06 devstack sudo[84575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c
Apr 15 14:35:06 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:07 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c" returned: 0 in 0.999s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:07 devstack sudo[84607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c
Apr 15 14:35:07 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:08 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4444db05-1f8b-4f7b-a351-e4f65e5ec25c" returned: 0 in 0.833s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Lock "cinder-quobyte-4444db05-1f8b-4f7b-a351-e4f65e5ec25c" released by "delete_volume" :: held 1.867s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Created reservations ['fd9ba978-76c5-43f8-97ca-4bab2dfe3243', 'eee4e56b-6ad0-4d5e-b25c-aadce177213a', '993a4083-5b9e-4d03-9096-dd483ca7646b', '6d593dab-8517-46fc-ad4b-62b8398ec0ee'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:08 devstack sudo[84613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:08 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-5e488275-bbcf-4171-898f-6482a743047f req-56a50a63-a94f-49f5-9747-52f67df6dfe8 tempest-DeleteServersTestJSON-736138816 None] Terminate volume connection completed successfully.
Apr 15 14:35:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-5e488275-bbcf-4171-898f-6482a743047f req-56a50a63-a94f-49f5-9747-52f67df6dfe8 tempest-DeleteServersTestJSON-736138816 None] Deleting attachment 7e50a5c2-15aa-4285-996c-c8e7758ddea7. {{(pid=83037) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 14:35:09 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.691s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Deleted volume successfully.
Apr 15 14:35:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b8ae844-2e0a-4f04-ba47-9985fd96702d tempest-VolumesTestJSON-1307794457 None] Lock "cinder-4444db05-1f8b-4f7b-a351-e4f65e5ec25c-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Flow 'volume_create_manager' (f3fddd3d-5241-4834-9b28-d9709ace6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e16226-a57c-4092-8549-f04195c83be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e16226-a57c-4092-8549-f04195c83be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2140013475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04ce689-07c9-45d7-bca1-10e0607955d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e564e150cfe4fc6972aa1b7675d8ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:11Z,use_quota=True,user_id='cf5b9ce7822c4627899ba0f9bd43b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9b92b3-3b56-4f30-a6df-330160e754df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9b92b3-3b56-4f30-a6df-330160e754df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312495c1-a84a-44a6-a696-317dcad68973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312495c1-a84a-44a6-a696-317dcad68973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04ce689-07c9-45d7-bca1-10e0607955d5', 'volume_name': 'volume-c04ce689-07c9-45d7-bca1-10e0607955d5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f36c0d-04fc-4833-aab9-2a2ddc1036a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f36c0d-04fc-4833-aab9-2a2ddc1036a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabfb214-b423-4607-ac84-73b53fe11047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Volume c04ce689-07c9-45d7-bca1-10e0607955d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04ce689-07c9-45d7-bca1-10e0607955d5', 'volume_size': 1}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2140013475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04ce689-07c9-45d7-bca1-10e0607955d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e564e150cfe4fc6972aa1b7675d8ce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:11Z,use_quota=True,user_id='cf5b9ce7822c4627899ba0f9bd43b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Creating volume c04ce689-07c9-45d7-bca1-10e0607955d5 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:35:11 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:11 devstack sudo[84618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5 1073741824
Apr 15 14:35:11 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:12 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5 1073741824" returned: 0 in 0.839s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:12 devstack sudo[84624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5
Apr 15 14:35:12 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:13 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5" returned: 0 in 0.741s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabfb214-b423-4607-ac84-73b53fe11047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04ce689-07c9-45d7-bca1-10e0607955d5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38157e7-906c-486f-9960-d677e0052d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Volume volume-c04ce689-07c9-45d7-bca1-10e0607955d5 (c04ce689-07c9-45d7-bca1-10e0607955d5): created successfully
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38157e7-906c-486f-9960-d677e0052d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Flow 'volume_create_manager' (f3fddd3d-5241-4834-9b28-d9709ace6efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0ec94b51-25a1-41a7-8dd2-d59fa592a9c4 tempest-ServerRescueNegativeTestJSON-232052771 None] Created volume successfully.
Apr 15 14:35:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Acquiring lock "cinder-50d65d56-0afc-442c-b260-0dbc4c3fdcd9-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Lock "cinder-50d65d56-0afc-442c-b260-0dbc4c3fdcd9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Acquiring lock "cinder-quobyte-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Lock "cinder-quobyte-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36ea543-a044-443d-9414-93ebb9534a40]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:14 devstack sudo[84629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9
Apr 15 14:35:14 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:15 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" returned: 0 in 0.998s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:15 devstack sudo[84634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9
Apr 15 14:35:15 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:16 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" returned: 0 in 1.008s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Lock "cinder-quobyte-50d65d56-0afc-442c-b260-0dbc4c3fdcd9" released by "delete_volume" :: held 2.106s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Created reservations ['85e10cc1-f206-4dc3-9b2c-9e21e91911af', 'bfc5dc82-5948-43ec-968d-6df978038e0e', '617e353b-f728-46d9-9b73-eb0c03da53a1', 'a6d4bef8-2d08-4b6f-bdfd-aef5f65651a2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:16 devstack sudo[84638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:16 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-70e5e2cd-6e79-41c9-a879-e414946183dc tempest-GroupSnapshotsTest-452815206 None] Group tempest-GroupSnapshotsTest-Group-94755826: creating
Apr 15 14:35:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-70e5e2cd-6e79-41c9-a879-e414946183dc tempest-GroupSnapshotsTest-452815206 None] Group tempest-GroupSnapshotsTest-Group-94755826: created successfully
Apr 15 14:35:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-70e5e2cd-6e79-41c9-a879-e414946183dc tempest-GroupSnapshotsTest-452815206 None] Create group completed successfully.
Apr 15 14:35:17 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.590s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Deleted volume successfully.
Apr 15 14:35:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef3e21d0-3140-4902-a5bc-8434017c9b18 tempest-DeleteServersTestJSON-736138816 None] Lock "cinder-50d65d56-0afc-442c-b260-0dbc4c3fdcd9-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (f429692a-281d-4437-bb28-fe637fd7b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc22aae-0cd9-4bf0-96bb-519dc8470492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc22aae-0cd9-4bf0-96bb-519dc8470492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978549668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9980f3a3-662e-4a0b-80ae-e3b29b5a5a05,host='devstack@QuobyteHD#QuobyteHD',id=c6a8acad-ccee-41ac-b217-1dfd266ed4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:19Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01da2586-bb4c-4c6f-81bb-e5feb0c4de96),volume_type_id=01da2586-bb4c-4c6f-81bb-e5feb0c4de96)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e1c590-76a2-4bcb-98d8-dee63cfbcc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e1c590-76a2-4bcb-98d8-dee63cfbcc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a030bce-b5c5-441a-8725-6f7a2d4a56cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a030bce-b5c5-441a-8725-6f7a2d4a56cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a8acad-ccee-41ac-b217-1dfd266ed4c8', 'volume_name': 'volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f4576-f41a-4c1a-a5d6-955a6bc96111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f4576-f41a-4c1a-a5d6-955a6bc96111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b8297f-e852-40ee-ae79-91e4ac95d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:18 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Volume c6a8acad-ccee-41ac-b217-1dfd266ed4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8', 'volume_size': 1}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9980f3a3-662e-4a0b-80ae-e3b29b5a5a05,created_at=2026-04-15T12:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978549668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9980f3a3-662e-4a0b-80ae-e3b29b5a5a05,host='devstack@QuobyteHD#QuobyteHD',id=c6a8acad-ccee-41ac-b217-1dfd266ed4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:19Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01da2586-bb4c-4c6f-81bb-e5feb0c4de96),volume_type_id=01da2586-bb4c-4c6f-81bb-e5feb0c4de96)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Creating volume c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:35:18 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:18 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 1073741824
Apr 15 14:35:18 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:19 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 1073741824" returned: 0 in 0.693s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:19 devstack sudo[84680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:19 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:20 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 0.745s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b8297f-e852-40ee-ae79-91e4ac95d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e83326-061b-46c9-99d4-5f32d16edc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Volume volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 (c6a8acad-ccee-41ac-b217-1dfd266ed4c8): created successfully
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e83326-061b-46c9-99d4-5f32d16edc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (f429692a-281d-4437-bb28-fe637fd7b2db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-45ab429e-0396-4ff1-ab9e-473d116e0692 tempest-GroupSnapshotsTest-452815206 None] Created volume successfully.
Apr 15 14:35:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] GroupSnapshot 0a2c843c-1867-4463-abd5-7062d567e349: creating.
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Group snapshot 0a2c843c-1867-4463-abd5-7062d567e349: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Creating offline snapshot 700de709-9c0f-45a4-b572-da693686f646 of volume c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea76ddb4-237e-4d0f-89e9-69e45686b805]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:21 devstack sudo[84686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:21 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:21 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 0.785s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:22 devstack sudo[84693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 1G
Apr 15 14:35:22 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:22 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 1G" returned: 0 in 0.709s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:22 devstack sudo[84700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646
Apr 15 14:35:22 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:23 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646" returned: 0 in 0.893s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:23 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:35:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:23 devstack sudo[84734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646
Apr 15 14:35:23 devstack sudo[84734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:24 devstack sudo[84734]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646" returned: 0 in 0.896s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:24 devstack sudo[84738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info
Apr 15 14:35:24 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:25 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info" returned: 0 in 0.846s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:25 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:35:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:25 devstack sudo[84741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info
Apr 15 14:35:25 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:26 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.info" returned: 0 in 0.649s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.905s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e5c8bda3-e115-400e-8610-11a21769ca88 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0a2c843c-1867-4463-abd5-7062d567e349: created successfully
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-700de709-9c0f-45a4-b572-da693686f646-bd2bf20f-ac50-4679-8ee0-1c955976321f" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-700de709-9c0f-45a4-b572-da693686f646-bd2bf20f-ac50-4679-8ee0-1c955976321f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Creating volume bd2bf20f-ac50-4679-8ee0-1c955976321f from snapshot 700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-bd2bf20f-ac50-4679-8ee0-1c955976321f" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-bd2bf20f-ac50-4679-8ee0-1c955976321f" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] snapshot: 700de709-9c0f-45a4-b572-da693686f646, volume: bd2bf20f-ac50-4679-8ee0-1c955976321f,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab348a-e4cf-4c94-9f24-64b423817b3b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:28 devstack sudo[84747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646
Apr 15 14:35:28 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:29 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646" returned: 0 in 1.073s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:35:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:35:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:35:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0c8138-a17e-4773-be37-6136e7a87e77]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:29 devstack sudo[84752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:29 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:30 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 1.312s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:30 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:35:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:30 devstack sudo[84758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f
Apr 15 14:35:30 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:36 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f" returned: 0 in 5.575s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2b5db2-4875-45c2-af2c-dc0b400a9ca0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:36 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:36 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:37 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 1.420s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:37 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:35:37 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Converted 1024.00 MB image at 183.64 MB/s
Apr 15 14:35:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:37 devstack sudo[84836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f
Apr 15 14:35:37 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:38 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=58,cinder:UPDATE=60,cinder:DELETE=7,cinder:INSERT=13 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:35:38 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=53,cinder:UPDATE=71,cinder:INSERT=15,cinder:DELETE=5 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:35:38 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f" returned: 0 in 0.916s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-bd2bf20f-ac50-4679-8ee0-1c955976321f" released by "_copy_volume_from_snapshot" :: held 10.432s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-700de709-9c0f-45a4-b572-da693686f646-bd2bf20f-ac50-4679-8ee0-1c955976321f" released by "_create_volume_from_snapshot" :: held 10.459s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.486s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5c1a6a63-f64c-461b-958d-4cf5b7270ae4 tempest-GroupSnapshotsTest-452815206 None] Create group from source-snapshot-0a2c843c-1867-4463-abd5-7062d567e349 completed successfully.
Apr 15 14:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-bd2bf20f-ac50-4679-8ee0-1c955976321f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-bd2bf20f-ac50-4679-8ee0-1c955976321f" acquired by "delete_volume" :: waited 0.027s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4916f7a-10af-4764-b54f-290875a64259]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:40 devstack sudo[84885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f
Apr 15 14:35:40 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:41 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f" returned: 0 in 1.237s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:41 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f
Apr 15 14:35:41 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:41 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bd2bf20f-ac50-4679-8ee0-1c955976321f" returned: 0 in 0.891s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-bd2bf20f-ac50-4679-8ee0-1c955976321f" released by "delete_volume" :: held 2.260s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Created reservations ['e3a8244b-f119-419a-b3d8-2259ecc581c6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:42 devstack cinder-volume[83037]: WARNING cinder.quota [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1324160670 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1324160670, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:35:42 devstack cinder-volume[83037]: WARNING cinder.quota [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1324160670 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1324160670, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Created reservations ['7bac8350-e373-4b19-a05f-eaf00652ff59', '8cd98789-f50e-46be-a19f-e4f3faec42b4', 'd5f0eafd-4cc1-43a6-a523-299881bee0ab', '6fe055cb-4ff9-41fa-983d-63f35221c4f6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:42 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:42 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Acquiring lock "cinder-c04ce689-07c9-45d7-bca1-10e0607955d5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "cinder-c04ce689-07c9-45d7-bca1-10e0607955d5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Acquiring lock "cinder-quobyte-c04ce689-07c9-45d7-bca1-10e0607955d5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "cinder-quobyte-c04ce689-07c9-45d7-bca1-10e0607955d5" acquired by "delete_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[925fad24-dc00-43d4-96df-ce662fdbf65a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:42 devstack sudo[84916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5
Apr 15 14:35:42 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0a2c843c-1867-4463-abd5-7062d567e349: deleting
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0a2c843c-1867-4463-abd5-7062d567e349: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-700de709-9c0f-45a4-b572-da693686f646" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-700de709-9c0f-45a4-b572-da693686f646" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Deleting offline snapshot 700de709-9c0f-45a4-b572-da693686f646 of volume c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:35:43 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] snapshot_file for this snap is: volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.369s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d0183451-5b4a-496b-a9ab-841bc85a22b2 tempest-GroupSnapshotsTest-452815206 None] Delete group completed successfully.
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f02a1a-2290-426a-88e0-56f6ee80ec8f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:43 devstack sudo[84946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646
Apr 15 14:35:43 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:44 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5" returned: 0 in 1.941s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:44 devstack sudo[84956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5
Apr 15 14:35:44 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:44 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646" returned: 0 in 0.988s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:35:44 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c8cd8-2fd0-4632-97ed-91d2e99f5a13]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:44 devstack sudo[84958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:44 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:45 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c04ce689-07c9-45d7-bca1-10e0607955d5" returned: 0 in 1.043s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "cinder-quobyte-c04ce689-07c9-45d7-bca1-10e0607955d5" released by "delete_volume" :: held 3.031s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Created reservations ['3b7dad8e-3db9-4050-8e8c-9b9c1e2662f1', '564bf4c8-2b47-4717-ae19-0da7902bfd62', '24866101-43ca-4d46-bc20-a37932a14c6b', '47da0c4f-73ed-418f-a18f-c97ba02141f0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:45 devstack sudo[84965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:45 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:46 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 1.624s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:46 devstack sudo[84974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646
Apr 15 14:35:46 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:46 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.040s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:46 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Deleted volume successfully.
Apr 15 14:35:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e38c826-8f22-4fee-8984-37b0412a4f91 tempest-ServerRescueNegativeTestJSON-232052771 None] Lock "cinder-c04ce689-07c9-45d7-bca1-10e0607955d5-delete_volume" released by "delete_volume" :: held 4.572s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:47 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646" returned: 0 in 1.223s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:47 devstack sudo[85020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646
Apr 15 14:35:47 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:47 devstack sudo[85022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:47 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:48 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.689s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:48 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8.700de709-9c0f-45a4-b572-da693686f646" returned: 0 in 0.721s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-700de709-9c0f-45a4-b572-da693686f646" released by "_delete_snapshot" :: held 4.798s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" released by "delete_snapshot" :: held 4.823s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:48 devstack cinder-volume[83037]: WARNING cinder.quota [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1324160670 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1324160670, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:35:48 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] Created reservations ['34e2a15f-1ed6-4b04-8e9f-a1cf444b92e7', 'a40e3ced-b98b-4f5c-9366-68157665e3bf', 'bdac2fcf-5e2a-4ac1-8cf5-0208d28ad329', '97943638-0abd-4252-93b7-8d0dbde2a3fa'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-26f6437a-90ef-46f2-b77b-b84187d51b49 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0a2c843c-1867-4463-abd5-7062d567e349: deleted successfully
Apr 15 14:35:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:35:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:35:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d40610-ccc5-442c-bec8-fb145a80c18f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:49 devstack sudo[85033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:49 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:49 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 0.650s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:50 devstack sudo[85040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8
Apr 15 14:35:50 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:50 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" returned: 0 in 0.686s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-c6a8acad-ccee-41ac-b217-1dfd266ed4c8" released by "delete_volume" :: held 1.411s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Created reservations ['fff1ee38-fd3c-4b55-9583-e3c5f924beb9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:50 devstack cinder-volume[83037]: WARNING cinder.db.sqlalchemy.api [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1324160670']
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Created reservations ['8a56d8f7-b75f-441b-9303-cd1d31b8a5e1', '15b8becf-0719-4ca3-a042-f12ec117395f', 'acb5c339-296d-4ada-a268-1398baf9a3de', '8ee500cb-05c1-4b70-9c04-8860a142c7ee'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:50 devstack sudo[85047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:35:50 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:51 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.691s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:51 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:35:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e97ccb72-c8fa-4183-9d9d-c3946163aeed tempest-GroupSnapshotsTest-452815206 None] Delete group completed successfully.
Apr 15 14:35:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-21f9bc37-f925-4c3c-b40b-2a0b7d7c5106 tempest-GroupSnapshotsTest-452815206 None] Group tempest-GroupSnapshotsTest-Group-1668660997: creating
Apr 15 14:35:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-21f9bc37-f925-4c3c-b40b-2a0b7d7c5106 tempest-GroupSnapshotsTest-452815206 None] Group tempest-GroupSnapshotsTest-Group-1668660997: created successfully
Apr 15 14:35:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-21f9bc37-f925-4c3c-b40b-2a0b7d7c5106 tempest-GroupSnapshotsTest-452815206 None] Create group completed successfully.
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (38923a7b-e46e-4208-aba1-b468cc3d8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888ed1af-1e70-4df9-b40d-a099f273529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888ed1af-1e70-4df9-b40d-a099f273529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125537824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=14914848-09e1-44d7-8843-c6cf588e7c7d,host='devstack@QuobyteHD#QuobyteHD',id=256d56a9-2d60-49f5-9322-d0e7acb8df88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:54Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c598f308-2e49-4f3e-a1de-d2ed82f53f19),volume_type_id=c598f308-2e49-4f3e-a1de-d2ed82f53f19)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bc013-32fa-4c65-9bd8-3e5ea5528e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bc013-32fa-4c65-9bd8-3e5ea5528e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6183a72-32ea-4f0f-8a1a-529f96e5c370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6183a72-32ea-4f0f-8a1a-529f96e5c370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256d56a9-2d60-49f5-9322-d0e7acb8df88', 'volume_name': 'volume-256d56a9-2d60-49f5-9322-d0e7acb8df88', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b5b238-d350-441e-8633-20a28d40e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b5b238-d350-441e-8633-20a28d40e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c466135-7e11-4fcc-b4bb-d3813cf64fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Volume 256d56a9-2d60-49f5-9322-d0e7acb8df88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256d56a9-2d60-49f5-9322-d0e7acb8df88', 'volume_size': 1}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=14914848-09e1-44d7-8843-c6cf588e7c7d,created_at=2026-04-15T12:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125537824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=14914848-09e1-44d7-8843-c6cf588e7c7d,host='devstack@QuobyteHD#QuobyteHD',id=256d56a9-2d60-49f5-9322-d0e7acb8df88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:54Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c598f308-2e49-4f3e-a1de-d2ed82f53f19),volume_type_id=c598f308-2e49-4f3e-a1de-d2ed82f53f19)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Creating volume 256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:35:54 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:54 devstack sudo[85122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 1073741824
Apr 15 14:35:54 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:54 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 1073741824" returned: 0 in 0.661s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:54 devstack sudo[85134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88
Apr 15 14:35:54 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:55 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88" returned: 0 in 0.803s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c466135-7e11-4fcc-b4bb-d3813cf64fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256d56a9-2d60-49f5-9322-d0e7acb8df88', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee70997-ae84-48bc-bbb0-a4ad1d575980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:55 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Volume volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 (256d56a9-2d60-49f5-9322-d0e7acb8df88): created successfully
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee70997-ae84-48bc-bbb0-a4ad1d575980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (38923a7b-e46e-4208-aba1-b468cc3d8785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-68174902-07b3-48c8-a24c-d9362ce228d9 tempest-GroupSnapshotsTest-452815206 None] Created volume successfully.
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (16f167a1-2f5b-4662-b726-4c5302a1d577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357c6a5a-407d-4c83-8ef6-ec53413f32e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357c6a5a-407d-4c83-8ef6-ec53413f32e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1237398071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=14914848-09e1-44d7-8843-c6cf588e7c7d,host='devstack@QuobyteHD#QuobyteHD',id=567c50ca-c02d-4b87-a6ce-d5e2d0376a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:57Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c598f308-2e49-4f3e-a1de-d2ed82f53f19),volume_type_id=c598f308-2e49-4f3e-a1de-d2ed82f53f19)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea0c62b-4951-4306-873d-19ee8eb0e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea0c62b-4951-4306-873d-19ee8eb0e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f5c66b-57fe-4a29-8f52-d17ba11cf9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f5c66b-57fe-4a29-8f52-d17ba11cf9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567c50ca-c02d-4b87-a6ce-d5e2d0376a1d', 'volume_name': 'volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fca17d-63ed-46f8-8d9b-cbb4530d8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fca17d-63ed-46f8-8d9b-cbb4530d8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90861762-f378-4032-a5eb-7f3dbccb0645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:56 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Volume 567c50ca-c02d-4b87-a6ce-d5e2d0376a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d', 'volume_size': 1}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=14914848-09e1-44d7-8843-c6cf588e7c7d,created_at=2026-04-15T12:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1237398071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=14914848-09e1-44d7-8843-c6cf588e7c7d,host='devstack@QuobyteHD#QuobyteHD',id=567c50ca-c02d-4b87-a6ce-d5e2d0376a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:35:57Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c598f308-2e49-4f3e-a1de-d2ed82f53f19),volume_type_id=c598f308-2e49-4f3e-a1de-d2ed82f53f19)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Creating volume 567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:35:56 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:35:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:56 devstack sudo[85154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d 1073741824
Apr 15 14:35:56 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:57 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d 1073741824" returned: 0 in 0.715s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:35:57 devstack sudo[85184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d
Apr 15 14:35:57 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:35:58 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90861762-f378-4032-a5eb-7f3dbccb0645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6499497-b35c-4e6d-bb67-9e0be1fb1032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:35:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Volume volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d (567c50ca-c02d-4b87-a6ce-d5e2d0376a1d): created successfully
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6499497-b35c-4e6d-bb67-9e0be1fb1032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:35:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (16f167a1-2f5b-4662-b726-4c5302a1d577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:35:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-80c07b70-fba6-4b8f-83aa-d7d3e0ce79d9 tempest-GroupSnapshotsTest-452815206 None] Created volume successfully.
Apr 15 14:35:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0e565621-a3e0-40f3-abb2-28c61e38724c tempest-GroupSnapshotsTest-452815206 None] Update group completed successfully.
Apr 15 14:36:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-031af457-7973-45cb-8cf7-2e5e3697adca tempest-GroupSnapshotsTest-452815206 None] Update group completed successfully.
Apr 15 14:36:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aecb8b3c-e482-4b23-978c-5d27fa3d2383 tempest-GroupSnapshotsTest-452815206 None] Update group completed successfully.
Apr 15 14:36:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a7cdb604-f78b-4e17-b814-65ed45abd806 tempest-GroupSnapshotsTest-452815206 None] Update group completed successfully.
Apr 15 14:36:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] GroupSnapshot 0c7307e7-1076-485c-b785-0ce3714942c9: creating.
Apr 15 14:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Group snapshot 0c7307e7-1076-485c-b785-0ce3714942c9: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 14:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Creating offline snapshot ab8d11c7-3677-4230-ac66-2d78c3c43410 of volume 567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:36:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce824c2e-cb91-4dec-acac-06afe6aa79ef]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:04 devstack sudo[85214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d
Apr 15 14:36:04 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:05 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:05 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 1G
Apr 15 14:36:05 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:06 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 1G" returned: 0 in 1.080s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:06 devstack sudo[85225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410
Apr 15 14:36:06 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:06 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410" returned: 0 in 0.738s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:06 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:06 devstack sudo[85240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410
Apr 15 14:36:06 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:07 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410" returned: 0 in 0.682s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:07 devstack sudo[85260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info
Apr 15 14:36:07 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:08 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info" returned: 0 in 0.719s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:08 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:08 devstack sudo[85280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info
Apr 15 14:36:08 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:08 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Flow 'volume_create_manager' (03b313ba-a1ff-4a0b-97f9-6d9ac4e68e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a37a50-9d49-453e-8e0b-dd451ad946b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a37a50-9d49-453e-8e0b-dd451ad946b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-514429607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1206863b8409416b84201898383f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:09Z,use_quota=True,user_id='da8be75a126e4ecbb18fbd62670c6e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f036fa-4119-4cc6-8930-e8c8137ac64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f036fa-4119-4cc6-8930-e8c8137ac64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde113a4-dd52-4989-abb1-1fa5ac64380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde113a4-dd52-4989-abb1-1fa5ac64380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38', 'volume_name': 'volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2721e1a-dd04-445f-bc01-f1362c18d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2721e1a-dd04-445f-bc01-f1362c18d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412be09c-a234-49fb-9327-e3faba599db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Volume bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38', 'volume_size': 1}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:09 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.info" returned: 0 in 1.209s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.216s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Creating offline snapshot e9279481-61a5-46a0-9596-8eca0844f3f9 of volume 256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d74bc-ee01-461b-825c-1dc2b644f3b4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:09 devstack sudo[85296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88
Apr 15 14:36:09 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:10 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88" returned: 0 in 0.733s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:10 devstack sudo[85301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 1G
Apr 15 14:36:10 devstack sudo[85301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:11 devstack sudo[85301]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 1G" returned: 0 in 0.983s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:11 devstack sudo[85307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9
Apr 15 14:36:11 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:11 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9" returned: 0 in 0.621s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:11 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:11 devstack sudo[85312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9
Apr 15 14:36:11 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:12 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9" returned: 0 in 0.776s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:12 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info
Apr 15 14:36:12 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:13 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info" returned: 0 in 0.651s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:13 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:13 devstack sudo[85347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info
Apr 15 14:36:13 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:14 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.info" returned: 0 in 0.738s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.586s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.883s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-514429607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1206863b8409416b84201898383f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:09Z,use_quota=True,user_id='da8be75a126e4ecbb18fbd62670c6e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Creating volume bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:14 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:14 devstack sudo[85356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 1073741824
Apr 15 14:36:14 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-78a72744-711c-4592-bfc5-668ce8c97d10 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0c7307e7-1076-485c-b785-0ce3714942c9: created successfully
Apr 15 14:36:14 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 1073741824" returned: 0 in 0.721s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:14 devstack sudo[85363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38
Apr 15 14:36:14 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0c7307e7-1076-485c-b785-0ce3714942c9: deleting
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0c7307e7-1076-485c-b785-0ce3714942c9: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-ab8d11c7-3677-4230-ac66-2d78c3c43410" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-ab8d11c7-3677-4230-ac66-2d78c3c43410" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Deleting offline snapshot ab8d11c7-3677-4230-ac66-2d78c3c43410 of volume 567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] snapshot_file for this snap is: volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c7d614-a57f-4e3d-b47a-074264b3c34a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:15 devstack sudo[85365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410
Apr 15 14:36:15 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:15 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38" returned: 0 in 0.763s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412be09c-a234-49fb-9327-e3faba599db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763b072a-3a61-4507-92f1-f079d938a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Volume volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 (bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38): created successfully
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763b072a-3a61-4507-92f1-f079d938a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Flow 'volume_create_manager' (03b313ba-a1ff-4a0b-97f9-6d9ac4e68e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-95debc2a-4b30-4dac-a6cf-aeb528c986e0 req-34dca5c9-2209-43d0-aacf-c7025435f328 tempest-VolumesGetTestJSON-348261662 None] Created volume successfully.
Apr 15 14:36:16 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410" returned: 0 in 0.756s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6705d939-5a41-4003-8814-97e21149513b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:16 devstack sudo[85372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d
Apr 15 14:36:16 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:16 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:16 devstack sudo[85377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410
Apr 15 14:36:16 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Acquiring lock "cinder-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Lock "cinder-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Acquiring lock "cinder-quobyte-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Lock "cinder-quobyte-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e575ae5-c304-4593-8652-ba30522f2bbe]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:17 devstack sudo[85381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38
Apr 15 14:36:17 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:17 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410" returned: 0 in 0.796s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:17 devstack sudo[85387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410
Apr 15 14:36:17 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:17 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38" returned: 0 in 0.908s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:17 devstack sudo[85399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38
Apr 15 14:36:17 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:18 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d.ab8d11c7-3677-4230-ac66-2d78c3c43410" returned: 0 in 0.751s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-ab8d11c7-3677-4230-ac66-2d78c3c43410" released by "_delete_snapshot" :: held 3.001s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" released by "delete_snapshot" :: held 3.026s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-256d56a9-2d60-49f5-9322-d0e7acb8df88" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-256d56a9-2d60-49f5-9322-d0e7acb8df88" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-e9279481-61a5-46a0-9596-8eca0844f3f9" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-e9279481-61a5-46a0-9596-8eca0844f3f9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Deleting offline snapshot e9279481-61a5-46a0-9596-8eca0844f3f9 of volume 256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] snapshot_file for this snap is: volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ac50d-9148-4ac6-9c0e-ea6a6eeebb9b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:18 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9
Apr 15 14:36:18 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:18 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38" returned: 0 in 0.794s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Lock "cinder-quobyte-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38" released by "delete_volume" :: held 1.752s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.quota [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Created reservations ['214891a3-f764-4e1f-b13e-e3099b164515', 'a592a2d6-16dc-4f7c-9393-ceb17e625177', 'b0f6bf6f-d755-43eb-90a7-b7ae0ca17280', '480e0c06-9797-460a-b47a-0e7b6525eaff'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:19 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:19 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:19 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9" returned: 0 in 1.402s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256d56a9-2d60-49f5-9322-d0e7acb8df88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:36:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715e238-77b3-44bc-9c1d-381ec3c2fd8a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:19 devstack sudo[85438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88
Apr 15 14:36:19 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:19 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.964s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:19 devstack cinder-volume[83037]: DEBUG cinder.manager [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Deleted volume successfully.
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-77ed9dea-10c8-45df-a0cb-702dce0584a9 req-44ebf650-3feb-43f5-8653-da5443426fb7 tempest-VolumesGetTestJSON-348261662 None] Lock "cinder-bdb3c5bf-ecc7-4c6f-8840-cc642ddaee38-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:20 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88" returned: 0 in 0.709s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:20 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9
Apr 15 14:36:20 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Flow 'volume_create_manager' (6709bacb-3353-4a2a-940c-a162384788e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1056e-d56a-4b37-b3c6-93590ee0e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1056e-d56a-4b37-b3c6-93590ee0e525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:20Z,deleted=False,deleted_at=None,display_description='',display_name='e7108e17-0064-485a-9959-6e5fe7617683-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0b385a-3db3-4526-aabd-c8bcdcd1fa32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162e6fea42d849c4a39aca5e801915ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:21Z,use_quota=True,user_id='9b5c36e3612f4e65a0548dcf2581158d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca663efa-0661-475e-8750-0b325b76c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca663efa-0661-475e-8750-0b325b76c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e8b79b-4c97-44b1-b813-be88552153d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e8b79b-4c97-44b1-b813-be88552153d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0b385a-3db3-4526-aabd-c8bcdcd1fa32', 'volume_name': 'volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0d55af-6f8b-47ea-b056-d7622ff5f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0d55af-6f8b-47ea-b056-d7622ff5f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec70f9a-716b-41f9-810d-7c466d9d0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Volume de0b385a-3db3-4526-aabd-c8bcdcd1fa32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32', 'volume_size': 1}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:20Z,deleted=False,deleted_at=None,display_description='',display_name='e7108e17-0064-485a-9959-6e5fe7617683-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0b385a-3db3-4526-aabd-c8bcdcd1fa32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162e6fea42d849c4a39aca5e801915ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:21Z,use_quota=True,user_id='9b5c36e3612f4e65a0548dcf2581158d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Creating volume de0b385a-3db3-4526-aabd-c8bcdcd1fa32 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:21 devstack sudo[85447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 1073741824
Apr 15 14:36:21 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Flow 'volume_create_manager' (97c69aec-1555-422d-ad59-ead7c3b0ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6fc53a-6583-414f-a7a7-77291368e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6fc53a-6583-414f-a7a7-77291368e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1119260914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e193e9-2c05-46c6-9a28-2031e320d941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4110cbd802c94ff292f8158b7e94d89b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:22Z,use_quota=True,user_id='6461f8d6a18d429ca1a630767a1d00ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8429caa-6e65-419d-aac9-cd2e28566cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8429caa-6e65-419d-aac9-cd2e28566cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0372bb0c-0af5-48af-9ea0-3ffa65fe0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0372bb0c-0af5-48af-9ea0-3ffa65fe0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e193e9-2c05-46c6-9a28-2031e320d941', 'volume_name': 'volume-01e193e9-2c05-46c6-9a28-2031e320d941', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c8f9a3-ec95-4e86-af7d-296c310874c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c8f9a3-ec95-4e86-af7d-296c310874c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799c39a0-5fe4-4daf-ba9a-9d6041ffdf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Volume 01e193e9-2c05-46c6-9a28-2031e320d941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e193e9-2c05-46c6-9a28-2031e320d941', 'volume_size': 1}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:22 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 1073741824" returned: 0 in 1.076s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:22 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32
Apr 15 14:36:22 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:22 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9" returned: 0 in 1.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:22 devstack sudo[85460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9
Apr 15 14:36:22 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:22 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88.e9279481-61a5-46a0-9596-8eca0844f3f9" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-e9279481-61a5-46a0-9596-8eca0844f3f9" released by "_delete_snapshot" :: held 4.555s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-256d56a9-2d60-49f5-9322-d0e7acb8df88" released by "delete_snapshot" :: held 4.577s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:22 devstack cinder-volume[83037]: WARNING cinder.quota [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1601878033 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1601878033, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:22 devstack cinder-volume[83037]: WARNING cinder.quota [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1601878033 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1601878033, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:22 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Created reservations ['438526e2-1861-4700-b83b-2c3372300109', '8ec4ceb4-9144-425a-9686-e8a509b19480', 'fce88bf3-8c62-4adb-b083-5a647f5a810d', 'f7fbe949-de7b-4ffb-ae6e-fc73c7dda7b1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] Created reservations ['1bd40285-6eb0-4895-bd0f-4eb2efe8fc0b', '8031cd4a-ba8e-4475-8911-da43e8b7ac87', '6ceff311-6315-4c21-b5e7-2a8f4dac0ce2', '67227ec8-eda5-45dc-a698-7f7f8fd5b013'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-42f8ad24-381e-4ea7-a7f4-945472046076 tempest-GroupSnapshotsTest-452815206 None] group_snapshot 0c7307e7-1076-485c-b785-0ce3714942c9: deleted successfully
Apr 15 14:36:23 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" returned: 0 in 1.088s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1119260914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e193e9-2c05-46c6-9a28-2031e320d941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4110cbd802c94ff292f8158b7e94d89b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:22Z,use_quota=True,user_id='6461f8d6a18d429ca1a630767a1d00ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Creating volume 01e193e9-2c05-46c6-9a28-2031e320d941 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:23 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec70f9a-716b-41f9-810d-7c466d9d0b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53489db-9ac3-46c8-81a3-df6b43ea4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:23 devstack sudo[85466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941 1073741824
Apr 15 14:36:23 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Volume volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 (de0b385a-3db3-4526-aabd-c8bcdcd1fa32): created successfully
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53489db-9ac3-46c8-81a3-df6b43ea4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Flow 'volume_create_manager' (6709bacb-3353-4a2a-940c-a162384788e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-adc467dc-22ea-470c-8b14-b5f607b98776 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Created volume successfully.
Apr 15 14:36:24 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941 1073741824" returned: 0 in 0.983s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:24 devstack sudo[85477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941
Apr 15 14:36:24 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-256d56a9-2d60-49f5-9322-d0e7acb8df88" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-256d56a9-2d60-49f5-9322-d0e7acb8df88" acquired by "delete_volume" :: waited 0.028s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3142c4d7-90f4-4f84-bdea-3c7d8584d1e8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:24 devstack sudo[85485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88
Apr 15 14:36:24 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:24 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941" returned: 0 in 0.733s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.298s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799c39a0-5fe4-4daf-ba9a-9d6041ffdf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e193e9-2c05-46c6-9a28-2031e320d941', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebd5b2b-6575-4a89-b22e-30c48e0ff263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[29df4ec0-8b4b-4582-a9a0-d02311debe40]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Volume volume-01e193e9-2c05-46c6-9a28-2031e320d941 (01e193e9-2c05-46c6-9a28-2031e320d941): created successfully
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebd5b2b-6575-4a89-b22e-30c48e0ff263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Flow 'volume_create_manager' (97c69aec-1555-422d-ad59-ead7c3b0ff39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-004d239a-e112-4b0d-bb5d-fd41b7ee7e4c tempest-GroupsV320Test-46423601 None] Group tempest-GroupsV320Test-Group-938044347: creating
Apr 15 14:36:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-174e51a5-f1f4-4479-811a-ed4c1a89473f tempest-ServersNegativeTestJSON-176823566 None] Created volume successfully.
Apr 15 14:36:25 devstack sudo[85488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32
Apr 15 14:36:25 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-004d239a-e112-4b0d-bb5d-fd41b7ee7e4c tempest-GroupsV320Test-46423601 None] Group tempest-GroupsV320Test-Group-938044347: created successfully
Apr 15 14:36:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-004d239a-e112-4b0d-bb5d-fd41b7ee7e4c tempest-GroupsV320Test-46423601 None] Create group completed successfully.
Apr 15 14:36:25 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88" returned: 0 in 0.801s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:25 devstack sudo[85506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88
Apr 15 14:36:25 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:25 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" returned: 0 in 0.872s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b', 'name': 'volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bee9433d-7b0c-4c18-bf81-bfb3c9961a4e', 'enforce_multipath': True} {{(pid=83037) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 14:36:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-e06d3b12-8dc5-499c-a233-a6513114e4b8 req-51c94600-6a22-4e09-89c6-54b6bf2854f6 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] attachment_update completed successfully.
Apr 15 14:36:26 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-256d56a9-2d60-49f5-9322-d0e7acb8df88" returned: 0 in 0.737s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-256d56a9-2d60-49f5-9322-d0e7acb8df88" released by "delete_volume" :: held 1.654s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b0f52-0388-453e-bfb3-ff10108657a4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:26 devstack sudo[85512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d
Apr 15 14:36:26 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Created reservations ['084c835e-7762-4762-bbf0-b0eba888a4fe'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Flow 'volume_create_manager' (172b7737-83d9-4c26-b5c9-d935efbbbfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80f2595-d740-417c-a382-8c4c0bd7b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:26 devstack sudo[85514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:26 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80f2595-d740-417c-a382-8c4c0bd7b36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-389856341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73560efa-dd4b-4704-9bbf-e8d626f435b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4110cbd802c94ff292f8158b7e94d89b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:27Z,use_quota=True,user_id='6461f8d6a18d429ca1a630767a1d00ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b77727-22e6-4f6d-aeee-f7acce4dcf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b77727-22e6-4f6d-aeee-f7acce4dcf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f74ecc-3cf9-4446-abc4-12e1a31fbf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f74ecc-3cf9-4446-abc4-12e1a31fbf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73560efa-dd4b-4704-9bbf-e8d626f435b0', 'volume_name': 'volume-73560efa-dd4b-4704-9bbf-e8d626f435b0', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d90c55-2e50-4d5b-866d-5f1d7ebb839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d90c55-2e50-4d5b-866d-5f1d7ebb839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6670715e-5dd1-4377-bcfe-569c2098b1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Volume 73560efa-dd4b-4704-9bbf-e8d626f435b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73560efa-dd4b-4704-9bbf-e8d626f435b0', 'volume_size': 1}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-389856341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73560efa-dd4b-4704-9bbf-e8d626f435b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4110cbd802c94ff292f8158b7e94d89b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:27Z,use_quota=True,user_id='6461f8d6a18d429ca1a630767a1d00ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Creating volume 73560efa-dd4b-4704-9bbf-e8d626f435b0 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:27 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:27 devstack sudo[85516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 1073741824
Apr 15 14:36:27 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:27 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" returned: 0 in 1.075s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:27 devstack sudo[85524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d
Apr 15 14:36:27 devstack sudo[85524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:27 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.753s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-21d746c7-942e-4b77-83af-8cebd3dcf63b tempest-GroupsV320Test-46423601 None] Delete group completed successfully.
Apr 15 14:36:27 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 1073741824" returned: 0 in 0.923s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:28 devstack sudo[85593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0
Apr 15 14:36:28 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:28 devstack sudo[85524]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" returned: 0 in 0.946s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-567c50ca-c02d-4b87-a6ce-d5e2d0376a1d" released by "delete_volume" :: held 2.174s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Created reservations ['e7d45f3c-7c1a-43a7-abeb-3b515860bcce'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:28 devstack cinder-volume[83037]: WARNING cinder.quota [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1601878033 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1601878033, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Created reservations ['07716a6a-8b86-433a-b997-4f443ca3d5f0', 'd071de2f-daa4-403e-acb4-eaf1abd9d84e', '84de3a1f-50b4-4300-a801-06fb0af158cb', '48ebbd97-a00e-4347-81bb-adb01bf14869'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Created reservations ['bb12129a-23b8-41c1-9463-f949873f34cd', '9d65448e-b1df-484d-8e30-48ff5f8a9c69', 'ccd4c490-d162-45bf-aa1e-44ee8a5de73f', '48441f75-a7b3-42b2-913c-7eafeb1a7e7e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:28 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0" returned: 0 in 0.846s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6670715e-5dd1-4377-bcfe-569c2098b1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73560efa-dd4b-4704-9bbf-e8d626f435b0', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67762d70-6fe4-4976-9832-98057d6033cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Volume volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 (73560efa-dd4b-4704-9bbf-e8d626f435b0): created successfully
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67762d70-6fe4-4976-9832-98057d6033cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:28 devstack sudo[85599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Flow 'volume_create_manager' (172b7737-83d9-4c26-b5c9-d935efbbbfc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:28 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-05ce40ee-77d3-4b15-be2a-1a44fd73b106 tempest-ServersNegativeTestJSON-176823566 None] Created volume successfully.
Apr 15 14:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "cinder-73560efa-dd4b-4704-9bbf-e8d626f435b0-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-73560efa-dd4b-4704-9bbf-e8d626f435b0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:29 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.036s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:29 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c54b81ef-e341-43ae-924a-2d8a5db290de tempest-GroupSnapshotsTest-452815206 None] Delete group completed successfully.
Apr 15 14:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "cinder-quobyte-73560efa-dd4b-4704-9bbf-e8d626f435b0" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-quobyte-73560efa-dd4b-4704-9bbf-e8d626f435b0" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a678e07-889a-4d5c-a3aa-69893141ccf5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e587dda-dde2-427c-a84a-7e580eae484d tempest-GroupSnapshotsTest-452815206 None] Group tempest-GroupSnapshotsTest-Group-614673700: creating
Apr 15 14:36:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e587dda-dde2-427c-a84a-7e580eae484d tempest-GroupSnapshotsTest-452815206 None] Group tempest-GroupSnapshotsTest-Group-614673700: created successfully
Apr 15 14:36:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e587dda-dde2-427c-a84a-7e580eae484d tempest-GroupSnapshotsTest-452815206 None] Create group completed successfully.
Apr 15 14:36:30 devstack sudo[85605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0
Apr 15 14:36:30 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:30 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0" returned: 0 in 0.729s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:30 devstack sudo[85938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0
Apr 15 14:36:30 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:31 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73560efa-dd4b-4704-9bbf-e8d626f435b0" returned: 0 in 0.837s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-quobyte-73560efa-dd4b-4704-9bbf-e8d626f435b0" released by "delete_volume" :: held 1.660s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Created reservations ['c36b9aa1-5b35-4eec-bbf1-8a7f45d5a339', 'b6cf421a-fb2e-4daf-93aa-d8bfb4f66621', '13217b8e-ea0e-4526-9f10-83872a67a83b', '0188a516-843c-4788-8392-0cba82e7d6da'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:31 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:31 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (457132ae-218b-4367-825d-b183ca5e7470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a503903-98d7-4ff5-9992-d56e0e580d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a503903-98d7-4ff5-9992-d56e0e580d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268411699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b183ddf9-2bf3-4a6a-8c51-c149e9ebc269,host='devstack@QuobyteHD#QuobyteHD',id=4d695d69-b214-444e-bc18-f32381c49231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:32Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17ad36d0-5994-4d62-bb3e-560c068a90f1),volume_type_id=17ad36d0-5994-4d62-bb3e-560c068a90f1)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5d17b-6e86-4edc-9b85-0d398e22aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5d17b-6e86-4edc-9b85-0d398e22aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615e139c-c188-4a46-a92c-be4f9607abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615e139c-c188-4a46-a92c-be4f9607abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d695d69-b214-444e-bc18-f32381c49231', 'volume_name': 'volume-4d695d69-b214-444e-bc18-f32381c49231', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feee78b-6170-4c36-b803-6a4203fe8e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feee78b-6170-4c36-b803-6a4203fe8e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91308505-9b05-4a1e-b4b0-a483f36fd76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Volume 4d695d69-b214-444e-bc18-f32381c49231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d695d69-b214-444e-bc18-f32381c49231', 'volume_size': 1}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b183ddf9-2bf3-4a6a-8c51-c149e9ebc269,created_at=2026-04-15T12:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268411699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b183ddf9-2bf3-4a6a-8c51-c149e9ebc269,host='devstack@QuobyteHD#QuobyteHD',id=4d695d69-b214-444e-bc18-f32381c49231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c94931d77943689e07dd6ff00d7976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:32Z,use_quota=True,user_id='54c0e906de744f61bccfc0f9faff24f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17ad36d0-5994-4d62-bb3e-560c068a90f1),volume_type_id=17ad36d0-5994-4d62-bb3e-560c068a90f1)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Creating volume 4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:32 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "cinder-01e193e9-2c05-46c6-9a28-2031e320d941-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-01e193e9-2c05-46c6-9a28-2031e320d941-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:32 devstack sudo[85955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 1073741824
Apr 15 14:36:32 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "cinder-quobyte-01e193e9-2c05-46c6-9a28-2031e320d941" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-quobyte-01e193e9-2c05-46c6-9a28-2031e320d941" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a2d622-702e-4558-bb28-b871e81f0ea2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:32 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Deleted volume successfully.
Apr 15 14:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68e1c93a-99a3-4791-acea-eac8a3b7a8f0 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-73560efa-dd4b-4704-9bbf-e8d626f435b0-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:32 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941
Apr 15 14:36:32 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:33 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 1073741824" returned: 0 in 0.917s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:33 devstack sudo[85966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231
Apr 15 14:36:33 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:33 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941" returned: 0 in 0.867s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:33 devstack sudo[85968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941
Apr 15 14:36:33 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:33 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231" returned: 0 in 0.538s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91308505-9b05-4a1e-b4b0-a483f36fd76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d695d69-b214-444e-bc18-f32381c49231', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168a3c15-f483-47dc-bf86-5714b0548a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Volume volume-4d695d69-b214-444e-bc18-f32381c49231 (4d695d69-b214-444e-bc18-f32381c49231): created successfully
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168a3c15-f483-47dc-bf86-5714b0548a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Flow 'volume_create_manager' (457132ae-218b-4367-825d-b183ca5e7470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-edecb41a-325c-420a-b9c5-aa707681b209 tempest-GroupSnapshotsTest-452815206 None] Created volume successfully.
Apr 15 14:36:33 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-01e193e9-2c05-46c6-9a28-2031e320d941" returned: 0 in 0.597s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-quobyte-01e193e9-2c05-46c6-9a28-2031e320d941" released by "delete_volume" :: held 1.490s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Created reservations ['e6bdb832-f626-471e-9c07-e88c80eb19d5', 'ede56ac4-65b2-46a1-9549-2108baf69afd', 'c7561060-2eff-4fa2-89b7-b5f04ecbfa4f', 'cf509567-aaf9-4060-89f2-80b997f33bc0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:33 devstack sudo[85973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:33 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:34 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.487s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Deleted volume successfully.
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be86939e-7425-448e-ae76-1f94a41e48f4 tempest-ServersNegativeTestJSON-176823566 None] Lock "cinder-01e193e9-2c05-46c6-9a28-2031e320d941-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] GroupSnapshot cb98c575-2b8d-45d2-8e32-ab7db74cd87a: creating.
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Group snapshot cb98c575-2b8d-45d2-8e32-ab7db74cd87a: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Creating offline snapshot 05e8c9fc-fde4-404e-a8c3-4d250dee5810 of volume 4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24dc13-e7e8-48aa-a71b-84fb66b72c95]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:34 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231
Apr 15 14:36:34 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:35 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231" returned: 0 in 0.827s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:35 devstack sudo[85983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 1G
Apr 15 14:36:35 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:35 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 1G" returned: 0 in 0.590s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d695d69-b214-444e-bc18-f32381c49231 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:35 devstack sudo[86009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d695d69-b214-444e-bc18-f32381c49231 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810
Apr 15 14:36:35 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:36 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d695d69-b214-444e-bc18-f32381c49231 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:36 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:36 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810
Apr 15 14:36:36 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:37 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:37 devstack sudo[86029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info
Apr 15 14:36:37 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:37 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:37 devstack sudo[86033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info
Apr 15 14:36:37 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:38 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.info" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.600s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=120,cinder:SELECT=119,cinder:INSERT=23,cinder:DELETE=6 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:36:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d942f745-c95e-4f54-9e0d-3100a6843d88 tempest-GroupSnapshotsTest-452815206 None] group_snapshot cb98c575-2b8d-45d2-8e32-ab7db74cd87a: created successfully
Apr 15 14:36:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] group_snapshot cb98c575-2b8d-45d2-8e32-ab7db74cd87a: deleting
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=139,cinder:SELECT=130,cinder:INSERT=35,cinder:DELETE=5 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] group_snapshot cb98c575-2b8d-45d2-8e32-ab7db74cd87a: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-4d695d69-b214-444e-bc18-f32381c49231" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-4d695d69-b214-444e-bc18-f32381c49231" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-05e8c9fc-fde4-404e-a8c3-4d250dee5810" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-05e8c9fc-fde4-404e-a8c3-4d250dee5810" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Deleting offline snapshot 05e8c9fc-fde4-404e-a8c3-4d250dee5810 of volume 4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] snapshot_file for this snap is: volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e51228-876e-4a88-82aa-d1a7d3434ad4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:39 devstack sudo[86045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810
Apr 15 14:36:39 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:39 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810" returned: 0 in 0.655s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d695d69-b214-444e-bc18-f32381c49231(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:36:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fac3ea-570e-405c-8ea4-f07b60a8ab00]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:39 devstack sudo[86067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231
Apr 15 14:36:39 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:40 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:40 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810
Apr 15 14:36:40 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:40 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810" returned: 0 in 0.533s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:40 devstack sudo[86092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810
Apr 15 14:36:40 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:41 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231.05e8c9fc-fde4-404e-a8c3-4d250dee5810" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-05e8c9fc-fde4-404e-a8c3-4d250dee5810" released by "_delete_snapshot" :: held 2.321s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-4d695d69-b214-444e-bc18-f32381c49231" released by "delete_snapshot" :: held 2.332s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:41 devstack cinder-volume[83037]: WARNING cinder.quota [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1604756980 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1604756980, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:41 devstack cinder-volume[83037]: WARNING cinder.quota [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1604756980 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1604756980, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:41 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] Created reservations ['17210266-03db-409e-a1ac-8c80f8da2290', '065e619e-5c1d-42ff-80dd-e4d8369364cd', '1142faa0-23d9-4e8a-9f4e-e732cb810f5b', '5f55e979-a6e4-42f1-b27a-939b92dc9c30'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b5920e85-d528-4f4d-b3d5-233419600f52 tempest-GroupSnapshotsTest-452815206 None] group_snapshot cb98c575-2b8d-45d2-8e32-ab7db74cd87a: deleted successfully
Apr 15 14:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "cinder-quobyte-4d695d69-b214-444e-bc18-f32381c49231" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-4d695d69-b214-444e-bc18-f32381c49231" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56ab020-4305-43af-8a62-d691925307c9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:42 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231
Apr 15 14:36:42 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:43 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:43 devstack sudo[86107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231
Apr 15 14:36:43 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:43 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4d695d69-b214-444e-bc18-f32381c49231" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Lock "cinder-quobyte-4d695d69-b214-444e-bc18-f32381c49231" released by "delete_volume" :: held 1.260s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Created reservations ['60320c40-2e9a-4c27-8ce8-74132bede477'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:43 devstack cinder-volume[83037]: WARNING cinder.quota [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1604756980 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1604756980, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Created reservations ['df65c3fa-08e3-4722-87f9-e39a0324b99a', 'e99ed911-30fc-4577-bb72-f3b05e195a1c', 'c09a790b-0c60-446d-938a-1ff104f6a249', 'b4fa5a0c-8036-4603-963e-c79853616c77'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:43 devstack sudo[86144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:43 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:44 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:44 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6d27035f-e77a-48c7-93d1-633ff3eefcbe tempest-GroupSnapshotsTest-452815206 None] Delete group completed successfully.
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:47 devstack sudo[86179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:36:47 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0948011-4b38-4f3c-ae1b-b8d28f36f716 tempest-GroupSnapshotsV319Test-1585348662 None] Group tempest-GroupSnapshotsV319Test-Group-1802595022: creating
Apr 15 14:36:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0948011-4b38-4f3c-ae1b-b8d28f36f716 tempest-GroupSnapshotsV319Test-1585348662 None] Group tempest-GroupSnapshotsV319Test-Group-1802595022: created successfully
Apr 15 14:36:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0948011-4b38-4f3c-ae1b-b8d28f36f716 tempest-GroupSnapshotsV319Test-1585348662 None] Create group completed successfully.
Apr 15 14:36:48 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.735s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Flow 'volume_create_manager' (8723fdfc-da48-4b80-89a8-1c5ad971e440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af1e38-6169-482f-84bf-dc4d394709a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af1e38-6169-482f-84bf-dc4d394709a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47321325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dd9dfef3-1835-44a1-a7bf-9bd477a91880,host='devstack@QuobyteHD#QuobyteHD',id=e69214a0-5c45-404e-aded-032917cb03f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980caf6664774db992b309f6ac92d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:49Z,use_quota=True,user_id='90da7f4f8eaf491da392ab962ca691a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ea20cf3-5244-4549-abb5-cae4be5cdb8c),volume_type_id=4ea20cf3-5244-4549-abb5-cae4be5cdb8c)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa50bedf-8002-47ec-8cf8-f0d9433c9e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa50bedf-8002-47ec-8cf8-f0d9433c9e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0f5ab0-843e-4369-bea7-ace82b408150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0f5ab0-843e-4369-bea7-ace82b408150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69214a0-5c45-404e-aded-032917cb03f0', 'volume_name': 'volume-e69214a0-5c45-404e-aded-032917cb03f0', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1d8752-e1b5-40ce-a1f9-96159d8ad5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1d8752-e1b5-40ce-a1f9-96159d8ad5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f372c487-d97a-486d-a7a7-d0255bc7b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Volume e69214a0-5c45-404e-aded-032917cb03f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69214a0-5c45-404e-aded-032917cb03f0', 'volume_size': 1}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dd9dfef3-1835-44a1-a7bf-9bd477a91880,created_at=2026-04-15T12:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47321325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dd9dfef3-1835-44a1-a7bf-9bd477a91880,host='devstack@QuobyteHD#QuobyteHD',id=e69214a0-5c45-404e-aded-032917cb03f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980caf6664774db992b309f6ac92d5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:49Z,use_quota=True,user_id='90da7f4f8eaf491da392ab962ca691a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ea20cf3-5244-4549-abb5-cae4be5cdb8c),volume_type_id=4ea20cf3-5244-4549-abb5-cae4be5cdb8c)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Creating volume e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:49 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:49 devstack sudo[86207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 1073741824
Apr 15 14:36:49 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Flow 'volume_create_manager' (72343733-ced5-4164-9e41-ca75b0ba60af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44ff0d7-c428-408d-b3ef-ec7cb0f7962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44ff0d7-c428-408d-b3ef-ec7cb0f7962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-630637097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c324ddf-e43a-4039-b9e5-42dd9e82b229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1857b3f145b045f3be97710414053dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:50Z,use_quota=True,user_id='31410f8698884090915309210221fb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43207d66-2849-4376-9064-1d177116a1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43207d66-2849-4376-9064-1d177116a1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af30f148-f346-43fc-b482-762de619feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af30f148-f346-43fc-b482-762de619feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c324ddf-e43a-4039-b9e5-42dd9e82b229', 'volume_name': 'volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09844a24-175b-495d-91e7-200433ba4a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09844a24-175b-495d-91e7-200433ba4a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd9040a-240a-4398-aacb-54af9b9a30d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Volume 8c324ddf-e43a-4039-b9e5-42dd9e82b229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229', 'volume_size': 1}
Apr 15 14:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:50 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 1073741824" returned: 0 in 0.778s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:50 devstack sudo[86241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0
Apr 15 14:36:50 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:50 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-630637097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c324ddf-e43a-4039-b9e5-42dd9e82b229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1857b3f145b045f3be97710414053dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:50Z,use_quota=True,user_id='31410f8698884090915309210221fb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Creating volume 8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:50 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f372c487-d97a-486d-a7a7-d0255bc7b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69214a0-5c45-404e-aded-032917cb03f0', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac834029-7f3a-4c65-a35f-f6c03bb11124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Volume volume-e69214a0-5c45-404e-aded-032917cb03f0 (e69214a0-5c45-404e-aded-032917cb03f0): created successfully
Apr 15 14:36:50 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 1073741824
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac834029-7f3a-4c65-a35f-f6c03bb11124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:50 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Flow 'volume_create_manager' (8723fdfc-da48-4b80-89a8-1c5ad971e440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3e641d8c-7686-4bbb-8d57-b2b1e23d8493 tempest-GroupSnapshotsV319Test-1585348662 None] Created volume successfully.
Apr 15 14:36:51 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 1073741824" returned: 0 in 0.700s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:51 devstack sudo[86273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229
Apr 15 14:36:51 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] GroupSnapshot 701d8e58-8968-48c0-9246-6855ecab0a5a: creating.
Apr 15 14:36:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Group snapshot 701d8e58-8968-48c0-9246-6855ecab0a5a: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 15 14:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:52 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.335s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd9040a-240a-4398-aacb-54af9b9a30d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fd065a-47d9-4a2d-80dc-09df463f6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:52 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Volume volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 (8c324ddf-e43a-4039-b9e5-42dd9e82b229): created successfully
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fd065a-47d9-4a2d-80dc-09df463f6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Flow 'volume_create_manager' (72343733-ced5-4164-9e41-ca75b0ba60af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Creating offline snapshot 89b5d04e-5a63-4856-b858-5caf38a9c684 of volume e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:36:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7f766778-3265-4632-92b5-d3197d94c609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Created volume successfully.
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[49819a64-43c6-4b94-a60a-d660ae52de89]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:52 devstack sudo[86280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0
Apr 15 14:36:52 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:52 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0" returned: 0 in 0.588s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:52 devstack sudo[86286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 1G
Apr 15 14:36:52 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:53 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 1G" returned: 0 in 0.597s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69214a0-5c45-404e-aded-032917cb03f0 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:53 devstack sudo[86293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69214a0-5c45-404e-aded-032917cb03f0 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684
Apr 15 14:36:53 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Flow 'volume_create_manager' (dee41d71-6bc3-4123-85ce-178d3dd7d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5351a605-8179-49c4-96aa-b245293abb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5351a605-8179-49c4-96aa-b245293abb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1532139171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5daeca-2c22-4dc9-9604-7870a232159a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a161afd82e4549aed2f5b27f6daed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:54Z,use_quota=True,user_id='1cd951ecce3541949fd6b557d04703bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d18318-156d-4d7b-afe8-f8384c984c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d18318-156d-4d7b-afe8-f8384c984c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee17423-f24b-4de8-9722-d03065c97d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee17423-f24b-4de8-9722-d03065c97d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5daeca-2c22-4dc9-9604-7870a232159a', 'volume_name': 'volume-1b5daeca-2c22-4dc9-9604-7870a232159a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6df88d4-a6ad-49ee-897b-91829cd181a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6df88d4-a6ad-49ee-897b-91829cd181a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286c6f11-2128-4ed6-abd9-6bfdb62a43d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Volume 1b5daeca-2c22-4dc9-9604-7870a232159a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5daeca-2c22-4dc9-9604-7870a232159a', 'volume_size': 1}
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:53 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69214a0-5c45-404e-aded-032917cb03f0 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:53 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684
Apr 15 14:36:53 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:54 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684" returned: 0 in 0.414s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:54 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info
Apr 15 14:36:54 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:54 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info" returned: 0 in 0.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:54 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:54 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info
Apr 15 14:36:54 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:55 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.info" returned: 0 in 0.424s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.049s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.891s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Creating offline snapshot aa254881-786b-4794-82a6-4d128deb6d64 of volume 8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8af62-24f1-4f2a-bc36-b54685bc53f7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d744b77a-f812-4cb4-b8ff-13a0c0585b3b tempest-GroupSnapshotsV319Test-1585348662 None] group_snapshot 701d8e58-8968-48c0-9246-6855ecab0a5a: created successfully
Apr 15 14:36:55 devstack sudo[86307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229
Apr 15 14:36:55 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:55 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229" returned: 0 in 0.474s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:55 devstack sudo[86312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 1G
Apr 15 14:36:55 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:56 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 1G" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:56 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64
Apr 15 14:36:56 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] group_snapshot 701d8e58-8968-48c0-9246-6855ecab0a5a: deleting
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] group_snapshot 701d8e58-8968-48c0-9246-6855ecab0a5a: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "cinder-quobyte-e69214a0-5c45-404e-aded-032917cb03f0" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "cinder-quobyte-e69214a0-5c45-404e-aded-032917cb03f0" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "cinder-quobyte-89b5d04e-5a63-4856-b858-5caf38a9c684" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "cinder-quobyte-89b5d04e-5a63-4856-b858-5caf38a9c684" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Deleting offline snapshot 89b5d04e-5a63-4856-b858-5caf38a9c684 of volume e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] snapshot_file for this snap is: volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbe8d06-c77a-4941-86f4-5ad3fe2f707a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:56 devstack sudo[86319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684
Apr 15 14:36:56 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:56 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 is being set with open permissions: ugo+rw
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:56 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64
Apr 15 14:36:56 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:56 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684" returned: 0 in 0.519s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69214a0-5c45-404e-aded-032917cb03f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c8d4fb-95d4-4884-93c2-246360412878]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:56 devstack sudo[86329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0
Apr 15 14:36:56 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:57 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:57 devstack sudo[86338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info
Apr 15 14:36:57 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:57 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0" returned: 0 in 0.609s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:57 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684
Apr 15 14:36:57 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:57 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:57 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info is being set with open permissions: ugo+rw
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:57 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info
Apr 15 14:36:57 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:57 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684" returned: 0 in 0.542s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:57 devstack sudo[86354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684
Apr 15 14:36:57 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:58 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.info" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.590s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1532139171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5daeca-2c22-4dc9-9604-7870a232159a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a161afd82e4549aed2f5b27f6daed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:36:54Z,use_quota=True,user_id='1cd951ecce3541949fd6b557d04703bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Creating volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:36:58 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:58 devstack sudo[86358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a 1073741824
Apr 15 14:36:58 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-de496232-2e97-41c1-9518-e5496fc0e741 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Create snapshot completed successfully
Apr 15 14:36:58 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0.89b5d04e-5a63-4856-b858-5caf38a9c684" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "cinder-quobyte-89b5d04e-5a63-4856-b858-5caf38a9c684" released by "_delete_snapshot" :: held 2.174s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Lock "cinder-quobyte-e69214a0-5c45-404e-aded-032917cb03f0" released by "delete_snapshot" :: held 2.184s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:36:58 devstack cinder-volume[83037]: WARNING cinder.quota [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1379071967 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1379071967, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:58 devstack cinder-volume[83037]: WARNING cinder.quota [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1379071967 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1379071967, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] Created reservations ['69821035-947f-4c58-9a56-4fe6e1a78309', '70082721-5d13-44c1-bfd0-fed133aee1c2', 'ac4103d0-e852-4836-b9a6-3fb790369528', '999e9373-24ef-4d22-9e66-48aa0084811a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:36:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-906cd999-9d27-48d4-b47a-c81469028897 tempest-GroupSnapshotsV319Test-1585348662 None] group_snapshot 701d8e58-8968-48c0-9246-6855ecab0a5a: deleted successfully
Apr 15 14:36:58 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a 1073741824" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:58 devstack sudo[86374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a
Apr 15 14:36:58 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "cinder-aa254881-786b-4794-82a6-4d128deb6d64-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-aa254881-786b-4794-82a6-4d128deb6d64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "cinder-quobyte-8c324ddf-e43a-4039-b9e5-42dd9e82b229" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-quobyte-8c324ddf-e43a-4039-b9e5-42dd9e82b229" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "cinder-quobyte-aa254881-786b-4794-82a6-4d128deb6d64" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-quobyte-aa254881-786b-4794-82a6-4d128deb6d64" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Deleting offline snapshot aa254881-786b-4794-82a6-4d128deb6d64 of volume 8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] snapshot_file for this snap is: volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[597d1dc6-ebec-4e64-a0d1-bdbdf0e92734]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:59 devstack sudo[86379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64
Apr 15 14:36:59 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:59 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286c6f11-2128-4ed6-abd9-6bfdb62a43d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5daeca-2c22-4dc9-9604-7870a232159a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d879f11e-b76e-4901-84a4-85f8a00d9c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:36:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Volume volume-1b5daeca-2c22-4dc9-9604-7870a232159a (1b5daeca-2c22-4dc9-9604-7870a232159a): created successfully
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d879f11e-b76e-4901-84a4-85f8a00d9c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Flow 'volume_create_manager' (dee41d71-6bc3-4123-85ce-178d3dd7d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:36:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-159608e1-5360-4adb-8db9-5c44fcca5783 tempest-SnapshotsActionsTest-1494671639 None] Created volume successfully.
Apr 15 14:36:59 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67c721-6a6f-4787-878c-17e7c0bcacb2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:59 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229
Apr 15 14:36:59 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "cinder-quobyte-e69214a0-5c45-404e-aded-032917cb03f0" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Lock "cinder-quobyte-e69214a0-5c45-404e-aded-032917cb03f0" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d33d7c5-0b9b-4782-a216-06169228535a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:36:59 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0
Apr 15 14:36:59 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:36:59 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229" returned: 0 in 0.535s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:00 devstack sudo[86396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64
Apr 15 14:37:00 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:00 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:00 devstack sudo[86399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0
Apr 15 14:37:00 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Creating offline snapshot ca9e40a9-fea6-4a73-9c24-73c642372abe of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a2132-67f0-4985-a9e9-63c28c0da109]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:00 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a
Apr 15 14:37:00 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:00 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:00 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64
Apr 15 14:37:00 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:00 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e69214a0-5c45-404e-aded-032917cb03f0" returned: 0 in 0.457s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Lock "cinder-quobyte-e69214a0-5c45-404e-aded-032917cb03f0" released by "delete_volume" :: held 0.981s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Created reservations ['8ee8c1e2-a397-4884-b91b-b9348c0d26ce'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:00 devstack cinder-volume[83037]: WARNING cinder.quota [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1379071967 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1379071967, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Created reservations ['713d49ff-274f-44ee-9065-0281b08f7604', '096e5046-a3b9-42b3-abff-a6097bb26acf', 'a011f66d-c14c-40f3-90a4-0b6958b46534', '949906c3-2811-440d-9a00-01ec4b36f205'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:00 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:00 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe 1G
Apr 15 14:37:00 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:00 devstack sudo[86414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:00 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:01 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229.aa254881-786b-4794-82a6-4d128deb6d64" returned: 0 in 0.504s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-quobyte-aa254881-786b-4794-82a6-4d128deb6d64" released by "_delete_snapshot" :: held 2.117s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-quobyte-8c324ddf-e43a-4039-b9e5-42dd9e82b229" released by "delete_snapshot" :: held 2.163s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:01 devstack cinder-volume[83037]: WARNING cinder.quota [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Created reservations ['f392e8db-bda1-4fe4-805e-4189249fa8ed', '968c0ae3-4115-425d-9fe0-27a4db478d7b', '2a987663-c366-4446-9d47-94cb2019f5ba', '2987e3e8-09a8-4baa-85c0-5aa16497018f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Delete snapshot completed successfully.
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee078fb9-a882-4cb6-a317-7970a21790d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-aa254881-786b-4794-82a6-4d128deb6d64-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:01 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2f2dd7bd-5fc1-49e9-9998-875db831ed0a tempest-GroupSnapshotsV319Test-1585348662 None] Delete group completed successfully.
Apr 15 14:37:01 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe 1G" returned: 0 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:01 devstack sudo[86424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:01 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:01 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:01 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe is being set with open permissions: ugo+rw
Apr 15 14:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:01 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:01 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "cinder-8c324ddf-e43a-4039-b9e5-42dd9e82b229-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-8c324ddf-e43a-4039-b9e5-42dd9e82b229-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "cinder-quobyte-8c324ddf-e43a-4039-b9e5-42dd9e82b229" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-quobyte-8c324ddf-e43a-4039-b9e5-42dd9e82b229" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84b337a-46b9-4eea-b00d-aaeac3102182]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:02 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:02 devstack sudo[86433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info
Apr 15 14:37:02 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:02 devstack sudo[86432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229
Apr 15 14:37:02 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:02 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:02 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info is being set with open permissions: ugo+rw
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:02 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:02 devstack sudo[86441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info
Apr 15 14:37:02 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:02 devstack sudo[86443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229
Apr 15 14:37:02 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:03 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.info" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.122s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4aca1b8f-7d97-4df4-b173-035bc96692f3 tempest-SnapshotsActionsTest-1494671639 None] Create snapshot completed successfully
Apr 15 14:37:03 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c324ddf-e43a-4039-b9e5-42dd9e82b229" returned: 0 in 0.846s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-quobyte-8c324ddf-e43a-4039-b9e5-42dd9e82b229" released by "delete_volume" :: held 1.456s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Created reservations ['f155644e-75bc-4630-bc6f-64462701493b', '637bff35-c08b-4b25-a492-fc56d5e70e9a', 'f449a95f-e253-4e7e-9404-e4b83a703b5b', '0c5e40ef-9102-4c11-9b7c-29f4bf00edba'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:03 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:03 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:04 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:04 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Deleted volume successfully.
Apr 15 14:37:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aef1a992-6dae-48bd-ae54-0840a9289462 tempest-VolumeSnapshotQuotasNegativeTestJSON-1959098505 None] Lock "cinder-8c324ddf-e43a-4039-b9e5-42dd9e82b229-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Creating offline snapshot 0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef1c19c-ef2f-482a-b66e-c581d622fecb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:05 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:05 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-085a5042-d346-410b-8695-7b0bdce542aa tempest-GroupsV314Test-1805790528 None] Group tempest-GroupsV314Test-Group-1633136898: creating
Apr 15 14:37:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-085a5042-d346-410b-8695-7b0bdce542aa tempest-GroupsV314Test-1805790528 None] Group tempest-GroupsV314Test-Group-1633136898: created successfully
Apr 15 14:37:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-085a5042-d346-410b-8695-7b0bdce542aa tempest-GroupsV314Test-1805790528 None] Create group completed successfully.
Apr 15 14:37:05 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.796s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:05 devstack sudo[86486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 1G
Apr 15 14:37:05 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:06 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 1G" returned: 0 in 0.659s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:06 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1
Apr 15 14:37:06 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:07 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:07 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 is being set with open permissions: ugo+rw
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:07 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1
Apr 15 14:37:07 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Flow 'volume_create_manager' (f71ec53a-6c18-43a7-b910-46dd85360db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98333273-3588-4fff-8927-3956107a754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98333273-3588-4fff-8927-3956107a754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965710045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08bd9545-ff5e-41d6-8c6c-d7a11b7e45c2,host='devstack@QuobyteHD#QuobyteHD',id=54d66dca-8660-4797-ac4b-4362d484512e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0ba4f66c6b4539a24aafb1fff44763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:07Z,use_quota=True,user_id='b8ac7db506d14e8c9e97cd13b63befcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c52dbf-a838-4f16-bf3d-c0f61cc4cb88),volume_type_id=90c52dbf-a838-4f16-bf3d-c0f61cc4cb88)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b495d39-1f99-471d-9334-36c74a30a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b495d39-1f99-471d-9334-36c74a30a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971f89c3-44d0-4043-977a-76afaf67c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971f89c3-44d0-4043-977a-76afaf67c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d66dca-8660-4797-ac4b-4362d484512e', 'volume_name': 'volume-54d66dca-8660-4797-ac4b-4362d484512e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aec5fa-662a-4424-a3cc-f588bbf01f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aec5fa-662a-4424-a3cc-f588bbf01f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f2c4cf-f7fb-40ec-8de1-dc6e31b73b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Volume 54d66dca-8660-4797-ac4b-4362d484512e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d66dca-8660-4797-ac4b-4362d484512e', 'volume_size': 1}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:07 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" returned: 0 in 0.524s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=08bd9545-ff5e-41d6-8c6c-d7a11b7e45c2,created_at=2026-04-15T12:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965710045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08bd9545-ff5e-41d6-8c6c-d7a11b7e45c2,host='devstack@QuobyteHD#QuobyteHD',id=54d66dca-8660-4797-ac4b-4362d484512e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0ba4f66c6b4539a24aafb1fff44763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:07Z,use_quota=True,user_id='b8ac7db506d14e8c9e97cd13b63befcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c52dbf-a838-4f16-bf3d-c0f61cc4cb88),volume_type_id=90c52dbf-a838-4f16-bf3d-c0f61cc4cb88)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Creating volume 54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:37:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:07 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e 1073741824
Apr 15 14:37:07 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d43d45cb-fc41-478d-a8a6-bf57c511d28f tempest-SnapshotsActionsTest-1494671639 None] Create snapshot completed successfully
Apr 15 14:37:08 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e 1073741824" returned: 0 in 0.621s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-0548d6a2-ecfc-4f39-a86f-48187ac8f9b1-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-0548d6a2-ecfc-4f39-a86f-48187ac8f9b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Deleting offline snapshot 0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:37:08 devstack sudo[86506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:08 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] snapshot_file for this snap is: volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1fe3e8-c8c0-4618-816f-bd96025fef1a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:08 devstack sudo[86509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1
Apr 15 14:37:08 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:08 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 0.490s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f2c4cf-f7fb-40ec-8de1-dc6e31b73b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d66dca-8660-4797-ac4b-4362d484512e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30452d62-7341-4792-8f8c-582c0f3aa538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Volume volume-54d66dca-8660-4797-ac4b-4362d484512e (54d66dca-8660-4797-ac4b-4362d484512e): created successfully
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30452d62-7341-4792-8f8c-582c0f3aa538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Flow 'volume_create_manager' (f71ec53a-6c18-43a7-b910-46dd85360db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b63d6db3-1c41-4e8c-82ce-a537d955536e tempest-GroupsV314Test-1805790528 None] Created volume successfully.
Apr 15 14:37:09 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" returned: 0 in 0.790s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc9b29-7846-4ff7-9850-1bab3bfca2f5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:09 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:09 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:09 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.670s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:09 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1
Apr 15 14:37:09 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:10 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Cloning volume 54d66dca-8660-4797-ac4b-4362d484512e to volume f6a75493-0f02-44b9-ac15-981e6ff008fe
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Creating offline snapshot 0d595b78-cd95-4d80-b6f2-feef4ce6f48b of volume 54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[43825ea7-af39-4a21-9e16-abf9c7a38558]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:10 devstack sudo[86546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:10 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:10 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" returned: 0 in 0.879s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:10 devstack sudo[86548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1
Apr 15 14:37:10 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:11 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 0.682s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:11 devstack sudo[86554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b 1G
Apr 15 14:37:11 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:11 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" returned: 0 in 0.654s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-0548d6a2-ecfc-4f39-a86f-48187ac8f9b1" released by "_delete_snapshot" :: held 3.074s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" released by "delete_snapshot" :: held 3.100s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Created reservations ['f98accaa-9275-4228-9681-1f6f0527705e', '0753f1b4-c066-48d1-9878-cf2ca2c8d139', '9d46d444-109e-40dc-9289-0b559eed469c', '41fcfc0b-4bfe-4524-b95d-9bc7e0aa18c6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Delete snapshot completed successfully.
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6949ed21-a521-42b6-8da7-2276715ede10 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-0548d6a2-ecfc-4f39-a86f-48187ac8f9b1-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:11 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b 1G" returned: 0 in 0.672s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d66dca-8660-4797-ac4b-4362d484512e -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:11 devstack sudo[86560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d66dca-8660-4797-ac4b-4362d484512e -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b
Apr 15 14:37:11 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:12 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d66dca-8660-4797-ac4b-4362d484512e -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b" returned: 0 in 0.654s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:12 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:12 devstack sudo[86565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b
Apr 15 14:37:12 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:13 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:13 devstack sudo[86568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info
Apr 15 14:37:13 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:13 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info" returned: 0 in 0.405s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:13 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:13 devstack sudo[86571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info
Apr 15 14:37:13 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:14 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.info" returned: 0 in 0.511s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Acquiring lock "cinder-quobyte-f6a75493-0f02-44b9-ac15-981e6ff008fe" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-f6a75493-0f02-44b9-ac15-981e6ff008fe" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] snapshot: 0d595b78-cd95-4d80-b6f2-feef4ce6f48b, volume: f6a75493-0f02-44b9-ac15-981e6ff008fe,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a682b07-6e6d-4b61-8284-b129ea8c2a8d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:14 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b
Apr 15 14:37:14 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:14 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b" returned: 0 in 0.626s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54d66dca-8660-4797-ac4b-4362d484512e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb102f4d-ccb2-49cc-9eee-f10b35b166d3]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:14 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:14 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:15 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:15 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:37:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:15 devstack sudo[86589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe
Apr 15 14:37:15 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:18 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe" returned: 0 in 3.337s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3b7ba4-a269-4d41-bb31-b94c62fb2459]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:18 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:18 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:19 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 0.718s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:19 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e, size 1024.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:37:19 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Converted 1024.00 MB image at 306.74 MB/s
Apr 15 14:37:19 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe is being set with open permissions: ugo+rw: NotImplementedError
Apr 15 14:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:19 devstack sudo[86608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe
Apr 15 14:37:19 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:20 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-f6a75493-0f02-44b9-ac15-981e6ff008fe" released by "_copy_volume_from_snapshot" :: held 5.994s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Acquiring lock "cinder-quobyte-0d595b78-cd95-4d80-b6f2-feef4ce6f48b" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-0d595b78-cd95-4d80-b6f2-feef4ce6f48b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Deleting offline snapshot 0d595b78-cd95-4d80-b6f2-feef4ce6f48b of volume 54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] snapshot_file for this snap is: volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[349d9850-e7fe-4e3d-909f-e6cf13cbeb19]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:20 devstack sudo[86611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b
Apr 15 14:37:20 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:20 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b" returned: 0 in 0.735s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54d66dca-8660-4797-ac4b-4362d484512e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ce7f78-82ee-4aec-886b-154102b907e0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:21 devstack sudo[86616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:21 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Flow 'volume_create_manager' (9b13c791-d912-457b-a50a-c8e7a79abb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e361b5d8-e87a-44ee-b0f7-e1d268b4c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e361b5d8-e87a-44ee-b0f7-e1d268b4c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a1d0d4-b47a-4eec-b077-1047b23024ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162e6fea42d849c4a39aca5e801915ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:22Z,use_quota=True,user_id='9b5c36e3612f4e65a0548dcf2581158d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d19dc04-f5e2-47c5-90e6-eb948e5c6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d19dc04-f5e2-47c5-90e6-eb948e5c6026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5e0bf8-bd61-42e6-a092-382574c0d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG cinder.image.glance [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 14:37:21 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 0.849s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:21 devstack sudo[86624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b
Apr 15 14:37:21 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5e0bf8-bd61-42e6-a092-382574c0d571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3a1d0d4-b47a-4eec-b077-1047b23024ba', 'volume_name': 'volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4baa8c700>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be4f140-a3ee-4c88-ba76-d226f43097f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be4f140-a3ee-4c88-ba76-d226f43097f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca54374-da38-451c-bf8e-5dc23b7921a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Volume d3a1d0d4-b47a-4eec-b077-1047b23024ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4baa8c700>}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Trying to clone d3a1d0d4-b47a-4eec-b077-1047b23024ba from image 87fa765b-69f0-4eaa-9650-38ed64870330 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 14:37:22 devstack cinder-volume[83037]: INFO cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c479ba1-8fd1-4e42-8786-06415c755665]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:22 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b" returned: 0 in 0.836s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:22 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD
Apr 15 14:37:22 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:22 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b
Apr 15 14:37:22 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:23 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 is fetched for user 9b5c36e3612f4e65a0548dcf2581158d. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc99fd-2a83-4170-9b5a-c1542b0f0097]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:23 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e.0d595b78-cd95-4d80-b6f2-feef4ce6f48b" returned: 0 in 0.536s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-0d595b78-cd95-4d80-b6f2-feef4ce6f48b" released by "_delete_snapshot" :: held 3.052s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.693s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.335s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Creating offline snapshot 20529d0d-d7a7-491e-ae4f-b5760431e9df of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:37:23 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD
Apr 15 14:37:23 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc8a017-6d78-4aa5-841f-e23321750573]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1035f098-9e1e-4ebb-9632-dad5692e80ba tempest-GroupsV314Test-1805790528 None] Create group from source-group-08bd9545-ff5e-41d6-8c6c-d7a11b7e45c2 completed successfully.
Apr 15 14:37:23 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:23 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:23 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:24 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.838s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:24 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df 1G
Apr 15 14:37:24 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Acquiring lock "cinder-quobyte-f6a75493-0f02-44b9-ac15-981e6ff008fe" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-f6a75493-0f02-44b9-ac15-981e6ff008fe" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[772919cb-b6ca-4161-8afa-c1d6ba1c5540]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:24 devstack sudo[86677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe
Apr 15 14:37:24 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:25 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df 1G" returned: 0 in 0.970s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:25 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df
Apr 15 14:37:25 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:25 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe" returned: 0 in 0.899s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:25 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe
Apr 15 14:37:25 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:25 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df" returned: 0 in 0.679s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:25 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df is being set with open permissions: ugo+rw
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:25 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df
Apr 15 14:37:25 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:25 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f6a75493-0f02-44b9-ac15-981e6ff008fe" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-f6a75493-0f02-44b9-ac15-981e6ff008fe" released by "delete_volume" :: held 1.494s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:25 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Created reservations ['a5d7d4f6-8ef2-4789-a9c4-db1795073421'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:26 devstack cinder-volume[83037]: WARNING cinder.quota [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1498639996 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1498639996, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:37:26 devstack cinder-volume[83037]: WARNING cinder.quota [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1498639996 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1498639996, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Created reservations ['621d4a12-ef93-48fc-abf0-c89f7ffcc7e8', '59d9ab3a-8afb-4512-82f8-7c439acc7994', '54944a2e-2c52-4876-82a3-fb80ffc4c21a', 'ce86cb93-3bb7-4be9-b5a7-b39de2e9d923'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:26 devstack sudo[86716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:26 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:26 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.545s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:21Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a1d0d4-b47a-4eec-b077-1047b23024ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162e6fea42d849c4a39aca5e801915ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:22Z,use_quota=True,user_id='9b5c36e3612f4e65a0548dcf2581158d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Creating volume d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:37:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4a084019-967f-4b2e-8720-a881252aa4d7 tempest-SnapshotsActionsTest-1494671639 None] Create snapshot completed successfully
Apr 15 14:37:26 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba 1073741824
Apr 15 14:37:26 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:26 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.706s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-978cf8ed-1ec9-4f46-ad69-35187f110c19 tempest-GroupsV314Test-1805790528 None] Delete group completed successfully.
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Acquiring lock "cinder-quobyte-54d66dca-8660-4797-ac4b-4362d484512e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-54d66dca-8660-4797-ac4b-4362d484512e" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb80313-e0cb-42e2-b55d-7d272ff6414b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:27 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:27 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:27 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba 1073741824" returned: 0 in 0.873s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:27 devstack sudo[86744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:37:27 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-20529d0d-d7a7-491e-ae4f-b5760431e9df-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-20529d0d-d7a7-491e-ae4f-b5760431e9df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-20529d0d-d7a7-491e-ae4f-b5760431e9df" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-20529d0d-d7a7-491e-ae4f-b5760431e9df" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Deleting offline snapshot 20529d0d-d7a7-491e-ae4f-b5760431e9df of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] snapshot_file for this snap is: volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5a8ae-4c64-4228-913f-ecb2ed4189b2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:28 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df
Apr 15 14:37:28 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:28 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 1.014s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:28 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e
Apr 15 14:37:28 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:28 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 0 in 1.232s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Attempting download of 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume d3a1d0d4-b47a-4eec-b077-1047b23024ba. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3fcc0e-6c8f-4acd-a94e-b11b5368e096]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:28 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-54d66dca-8660-4797-ac4b-4362d484512e" returned: 0 in 0.694s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Lock "cinder-quobyte-54d66dca-8660-4797-ac4b-4362d484512e" released by "delete_volume" :: held 1.744s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:28 devstack sudo[86756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p
Apr 15 14:37:28 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Created reservations ['bd50e625-8f47-46bb-b031-a95c59f97a4e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Created reservations ['0292abc9-b5d7-4398-9f48-911132e7356e', '48f1f425-ec36-4186-8eda-22b873d01049', '98dc6a63-ae55-4b93-9206-4c4f9ad34d1a', '88303786-44bf-4a54-ae19-60e250211fab'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:28 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df" returned: 0 in 1.232s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7dcf8-5107-46c7-897f-abfb3bf7e127]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:29 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:29 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:29 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:29 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:29 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p" returned: 0 in 1.014s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:29 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p
Apr 15 14:37:29 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:30 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 1.086s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:30 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df
Apr 15 14:37:30 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:30 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.169s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-14621068-d71a-4636-bb97-a0d1820cb628 tempest-GroupsV314Test-1805790528 None] Delete group completed successfully.
Apr 15 14:37:30 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p" returned: 1 in 1.100s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_smxqpf3p' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5508355d-9344-48d6-815a-36b95f23538c]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:31 devstack sudo[86780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD
Apr 15 14:37:31 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:31 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df" returned: 0 in 0.948s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:31 devstack sudo[86782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df
Apr 15 14:37:31 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:31 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.20529d0d-d7a7-491e-ae4f-b5760431e9df" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-20529d0d-d7a7-491e-ae4f-b5760431e9df" released by "_delete_snapshot" :: held 3.994s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" released by "delete_snapshot" :: held 4.027s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Created reservations ['c94be1ff-d621-413c-b53a-8d9bcb0400d7', '548a87aa-d408-460d-a47a-256e1278c111', '9043cde8-79b8-4a2e-8ac0-a6050a96869d', 'bea617b2-9952-45fa-89c8-94eab2daef8b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Delete snapshot completed successfully.
Apr 15 14:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba28ea71-b540-407c-9b24-ee6543274bf2 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-20529d0d-d7a7-491e-ae4f-b5760431e9df-delete_snapshot" released by "delete_snapshot" :: held 4.210s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:32 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD" returned: 0 in 1.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] 87fa765b-69f0-4eaa-9650-38ed64870330 was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:32 devstack sudo[86791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:37:32 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Creating offline snapshot b0f0352a-b712-42ea-a737-ff90641ce593 of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a963170-1fbd-468c-a249-8679a9883a61]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:32 devstack sudo[86793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:32 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:33 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.835s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:33 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 1G
Apr 15 14:37:33 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:33 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 0 in 1.640s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_dmi6996mdevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:37:34 devstack cinder-volume[83037]: INFO cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Converted 112.00 MB image at 68.23 MB/s
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:34 devstack sudo[86817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba 1G
Apr 15 14:37:34 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:34 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 1G" returned: 0 in 1.047s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:34 devstack sudo[86825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593
Apr 15 14:37:34 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:34 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba 1G" returned: 0 in 0.756s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594b43a-3035-44bf-b852-eb6b1a0b7eb3]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:34 devstack sudo[86827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:37:34 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:35 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593" returned: 0 in 0.822s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:35 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 is being set with open permissions: ugo+rw
Apr 15 14:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:35 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593
Apr 15 14:37:35 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:35 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 0 in 0.771s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:35 devstack sudo[86836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:37:35 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:36 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.399s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7d7daa58-bf7a-4e22-aec6-112676ab0cac tempest-SnapshotsActionsTest-1494671639 None] Create snapshot completed successfully
Apr 15 14:37:36 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 1 in 0.595s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Downloaded image 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume d3a1d0d4-b47a-4eec-b077-1047b23024ba successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 for user 9b5c36e3612f4e65a0548dcf2581158d is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Marking volume d3a1d0d4-b47a-4eec-b077-1047b23024ba as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Copying metadata from image 87fa765b-69f0-4eaa-9650-38ed64870330 to d3a1d0d4-b47a-4eec-b077-1047b23024ba. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Creating volume glance metadata for volume d3a1d0d4-b47a-4eec-b077-1047b23024ba backed by image 87fa765b-69f0-4eaa-9650-38ed64870330 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca54374-da38-451c-bf8e-5dc23b7921a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4baa8c700>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05915f0-d2f3-4663-824a-448816c1770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:36 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Volume volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba (d3a1d0d4-b47a-4eec-b077-1047b23024ba): created successfully
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05915f0-d2f3-4663-824a-448816c1770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Flow 'volume_create_manager' (9b13c791-d912-457b-a50a-c8e7a79abb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-44f4e542-c61b-4a22-82b2-23e17356f3aa tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Created volume successfully.
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-b0f0352a-b712-42ea-a737-ff90641ce593-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-b0f0352a-b712-42ea-a737-ff90641ce593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-b0f0352a-b712-42ea-a737-ff90641ce593" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-b0f0352a-b712-42ea-a737-ff90641ce593" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Deleting offline snapshot b0f0352a-b712-42ea-a737-ff90641ce593 of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] snapshot_file for this snap is: volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d729e-1d0b-4c29-9383-a0af9f49a6f9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:37 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593
Apr 15 14:37:37 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0fa1a6-475d-4e09-93c6-540c6fd90c90]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:37 devstack sudo[86858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:37:37 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:37 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593" returned: 0 in 0.691s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060dd94-d41c-416c-878e-6eac216c530b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:37 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:37 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:38 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 0 in 0.807s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:38 devstack sudo[86868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:37:38 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:38 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.684s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:38 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593
Apr 15 14:37:38 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:38 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 1 in 0.716s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.556s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=120,cinder:INSERT=38,cinder:UPDATE=111,cinder:DELETE=7 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=109,cinder:SELECT=121,cinder:INSERT=29,cinder:DELETE=4 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b', 'name': 'volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06195364-500e-40b2-b425-1246df1189bb', 'enforce_multipath': True} {{(pid=83037) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 15 14:37:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-a773187d-d7af-4e5a-ab25-4510821ddc6f req-7d1da56e-9383-4317-85c6-f02a94f438cd tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] attachment_update completed successfully.
Apr 15 14:37:39 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593" returned: 0 in 0.691s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:39 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593
Apr 15 14:37:39 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:39 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.b0f0352a-b712-42ea-a737-ff90641ce593" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-b0f0352a-b712-42ea-a737-ff90641ce593" released by "_delete_snapshot" :: held 2.684s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" released by "delete_snapshot" :: held 2.704s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Created reservations ['d6527970-d610-4172-9c95-5b32c1955cac', '79ae744d-5cd4-4cc1-8779-e14887b0af4b', '10a288e6-0df3-4d86-8224-ce338243b79f', 'ddaba08c-7e78-4d39-a76a-ec419b33ac44'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Delete snapshot completed successfully.
Apr 15 14:37:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8f231a7-c2c9-4072-9db1-a3f677160b80 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-b0f0352a-b712-42ea-a737-ff90641ce593-delete_snapshot" released by "delete_snapshot" :: held 2.822s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Creating offline snapshot feb23d17-9c92-4c85-8d15-dc962b0242c2 of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:37:40 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e40c6-318b-4beb-84fa-9739a56183bb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:40 devstack sudo[86901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:40 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:41 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.662s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:41 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 1G
Apr 15 14:37:41 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:41 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 1G" returned: 0 in 0.636s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:41 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2
Apr 15 14:37:41 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:42 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:42 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 is being set with open permissions: ugo+rw
Apr 15 14:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:42 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2
Apr 15 14:37:42 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:42 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7a1e29d5-761b-4395-9b99-431d8042fa28 tempest-SnapshotsActionsTest-1494671639 None] Create snapshot completed successfully
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Flow 'volume_create_manager' (197259e3-bf06-4ce1-ba34-b6d5bd6815cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b2f9fd-bc65-4466-a9b0-7fb545557b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b2f9fd-bc65-4466-a9b0-7fb545557b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-358012058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39e73a8da04122ba360810ae52b8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:43Z,use_quota=True,user_id='547c036d0db14d21affabb79c69543ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a809010-1642-452c-bf87-534415bfda09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a809010-1642-452c-bf87-534415bfda09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da70851-f07b-48eb-bed5-176d5f4c1fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da70851-f07b-48eb-bed5-176d5f4c1fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9', 'volume_name': 'volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a382596-4760-4d59-9f5c-1b358512fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a382596-4760-4d59-9f5c-1b358512fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec7ebb9-4c74-4d1f-b8a3-43660e688381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Volume 6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9', 'volume_size': 1}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-358012058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39e73a8da04122ba360810ae52b8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:43Z,use_quota=True,user_id='547c036d0db14d21affabb79c69543ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Creating volume 6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:37:43 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:43 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 1073741824
Apr 15 14:37:43 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-feb23d17-9c92-4c85-8d15-dc962b0242c2-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-feb23d17-9c92-4c85-8d15-dc962b0242c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Acquiring lock "cinder-quobyte-feb23d17-9c92-4c85-8d15-dc962b0242c2" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-feb23d17-9c92-4c85-8d15-dc962b0242c2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Deleting offline snapshot feb23d17-9c92-4c85-8d15-dc962b0242c2 of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] snapshot_file for this snap is: volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced1732e-745a-4c37-b2bc-64bd01d9ee30]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:43 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2
Apr 15 14:37:43 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:43 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 1073741824" returned: 0 in 0.749s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:44 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9
Apr 15 14:37:44 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:44 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9" returned: 0 in 0.814s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec7ebb9-4c74-4d1f-b8a3-43660e688381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05184ee3-3147-4697-a41e-0523c11c0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Volume volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 (6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9): created successfully
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05184ee3-3147-4697-a41e-0523c11c0b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Flow 'volume_create_manager' (197259e3-bf06-4ce1-ba34-b6d5bd6815cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f21100c4-4a0e-47ee-a42c-8631fd1b67da tempest-VolumesMetadataTest-629832590 None] Created volume successfully.
Apr 15 14:37:45 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2" returned: 0 in 1.155s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[626e546e-4ed4-4ea5-98b9-545c13d9aad0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:45 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:45 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:45 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.590s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:45 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2
Apr 15 14:37:45 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Acquiring lock "cinder-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Lock "cinder-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Acquiring lock "cinder-quobyte-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Lock "cinder-quobyte-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4439144-8293-4523-b721-ff0035e4a204]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:46 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2" returned: 0 in 0.829s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:46 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2
Apr 15 14:37:46 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:46 devstack sudo[87046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9
Apr 15 14:37:46 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:47 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.feb23d17-9c92-4c85-8d15-dc962b0242c2" returned: 0 in 0.648s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-feb23d17-9c92-4c85-8d15-dc962b0242c2" released by "_delete_snapshot" :: held 3.321s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" released by "delete_snapshot" :: held 3.337s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Created reservations ['b6a975ed-8208-4536-850d-92e4ac573ad9', '7bf5961f-eafe-4b95-982c-f413a920a54d', '1a113169-ca3e-411b-88c8-c9b16cac8b7d', 'da2d6a24-a9d6-4853-acf1-6dca9064e489'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Delete snapshot completed successfully.
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e575d48-56c9-413d-a896-8ddee39b6da8 tempest-SnapshotsActionsTest-952099921 None] Lock "cinder-feb23d17-9c92-4c85-8d15-dc962b0242c2-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:47 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9" returned: 0 in 0.936s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:47 devstack sudo[87055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9
Apr 15 14:37:47 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:47 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:47 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:48 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9" returned: 0 in 0.673s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Lock "cinder-quobyte-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9" released by "delete_volume" :: held 1.655s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (16aaf822-eeee-4b3c-9e20-26ac4373663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14457045-6f67-441f-afff-227acdb5838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14457045-6f67-441f-afff-227acdb5838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147603910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accb96f0-7a4d-4075-989f-9b780020f74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:48Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7ff8cd-58b5-4e30-ba61-f6abb3a05903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7ff8cd-58b5-4e30-ba61-f6abb3a05903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4dee4a-0526-46f7-96ac-e9771477fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4dee4a-0526-46f7-96ac-e9771477fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accb96f0-7a4d-4075-989f-9b780020f74e', 'volume_name': 'volume-accb96f0-7a4d-4075-989f-9b780020f74e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80549fe-79a4-4a76-b557-892c00f9e0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80549fe-79a4-4a76-b557-892c00f9e0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda549b2-dcbc-455c-9fab-114eba1689d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Volume accb96f0-7a4d-4075-989f-9b780020f74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accb96f0-7a4d-4075-989f-9b780020f74e', 'volume_size': 1}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147603910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accb96f0-7a4d-4075-989f-9b780020f74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:48Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Creating volume accb96f0-7a4d-4075-989f-9b780020f74e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:37:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Created reservations ['2c53ac8f-ef2a-4058-823d-470133d4b2e2', 'c9d31ce6-f2b2-45a3-8c19-7c6d82e37c97', '895447fc-7b5e-487c-9809-e86dd8dfdffa', '5e9e63a3-01d8-4c57-93e7-e1a8557dbe69'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:48 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e 1073741824
Apr 15 14:37:48 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:48 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:48 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:48 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.080s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "cinder-ca9e40a9-fea6-4a73-9c24-73c642372abe-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-ca9e40a9-fea6-4a73-9c24-73c642372abe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "cinder-quobyte-ca9e40a9-fea6-4a73-9c24-73c642372abe" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-quobyte-ca9e40a9-fea6-4a73-9c24-73c642372abe" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Deleting offline snapshot ca9e40a9-fea6-4a73-9c24-73c642372abe of volume 1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] snapshot_file for this snap is: volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[999ecbd1-70a7-435f-89ad-defc226ec88f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:49 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:49 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:49 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.201s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Deleted volume successfully.
Apr 15 14:37:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-368356c0-c8aa-4b9d-a1d7-6948c5c8c834 tempest-VolumesMetadataTest-629832590 None] Lock "cinder-6f4d2fbe-bc6d-438f-afde-877fa5c2f3f9-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:50 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e 1073741824" returned: 0 in 1.623s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:50 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e
Apr 15 14:37:50 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:50 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 1.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5daeca-2c22-4dc9-9604-7870a232159a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[810d6bd4-10b6-4bcb-b12a-f01bb6ad0154]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:50 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e" returned: 0 in 0.768s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.432s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda549b2-dcbc-455c-9fab-114eba1689d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accb96f0-7a4d-4075-989f-9b780020f74e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50b63d4-d560-475d-b97e-814d9ac83c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:50 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a
Apr 15 14:37:50 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Volume volume-accb96f0-7a4d-4075-989f-9b780020f74e (accb96f0-7a4d-4075-989f-9b780020f74e): created successfully
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50b63d4-d560-475d-b97e-814d9ac83c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (16aaf822-eeee-4b3c-9e20-26ac4373663d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3ebd64f9-38e6-47d2-bb23-abe3919ad147 tempest-VolumesActionsTest-1661868918 None] Created volume successfully.
Apr 15 14:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c88fc271-b59c-418b-92db-55edeb7c029c tempest-VolumesActionsTest-1661868918 None] Acquiring lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e" by "attach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c88fc271-b59c-418b-92db-55edeb7c029c tempest-VolumesActionsTest-1661868918 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e" acquired by "attach_volume" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c88fc271-b59c-418b-92db-55edeb7c029c tempest-VolumesActionsTest-1661868918 None] Attaching volume accb96f0-7a4d-4075-989f-9b780020f74e to instance d2649741-8bc7-4259-8724-e67e6a02df02 at mountpoint /dev/vdb on host None.
Apr 15 14:37:51 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a" returned: 0 in 1.115s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:51 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:51 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c88fc271-b59c-418b-92db-55edeb7c029c tempest-VolumesActionsTest-1661868918 None] Attach volume completed successfully.
Apr 15 14:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c88fc271-b59c-418b-92db-55edeb7c029c tempest-VolumesActionsTest-1661868918 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e" released by "attach_volume" :: held 0.234s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:52 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.730s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:52 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe
Apr 15 14:37:52 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-af6a4546-0aa1-48e9-bb76-230548c75880 tempest-VolumesActionsTest-1765062541 None] Terminate volume connection completed successfully.
Apr 15 14:37:53 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a.ca9e40a9-fea6-4a73-9c24-73c642372abe" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-quobyte-ca9e40a9-fea6-4a73-9c24-73c642372abe" released by "_delete_snapshot" :: held 3.929s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" released by "delete_snapshot" :: held 3.962s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Created reservations ['3705c8cb-7a26-4d1b-8c75-416c67ef8708', '593bad3a-ebcd-46c8-91ce-f8517d9cd39d', '5b5ee294-9567-4cdd-a9da-a3ba75143972', '312f17be-bb30-42fc-b26e-cef3f478aa21'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Delete snapshot completed successfully.
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f7b4284-6815-4f2a-b75a-1a6775421af4 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-ca9e40a9-fea6-4a73-9c24-73c642372abe-delete_snapshot" released by "delete_snapshot" :: held 4.110s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af6a4546-0aa1-48e9-bb76-230548c75880 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af6a4546-0aa1-48e9-bb76-230548c75880 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-af6a4546-0aa1-48e9-bb76-230548c75880 tempest-VolumesActionsTest-1765062541 None] Detaching volume accb96f0-7a4d-4075-989f-9b780020f74e from instance d2649741-8bc7-4259-8724-e67e6a02df02.
Apr 15 14:37:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-af6a4546-0aa1-48e9-bb76-230548c75880 tempest-VolumesActionsTest-1765062541 None] Detach volume completed successfully.
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af6a4546-0aa1-48e9-bb76-230548c75880 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Flow 'volume_create_manager' (4c696207-b6e1-4439-afa9-b90d464bacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98f27a5-e123-40ab-a557-95b6b1e3da94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98f27a5-e123-40ab-a557-95b6b1e3da94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1309709063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a85ab5-5f10-4372-8c81-d9c7d7dbb50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fd83d75ea44968b861f68cc737eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:53Z,use_quota=True,user_id='c63e064fba6e4439aa51537e541f4e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52806cff-a629-49d0-a1ae-23251f7a93d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52806cff-a629-49d0-a1ae-23251f7a93d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4491ac-d446-4931-ad8f-daa6184d661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4491ac-d446-4931-ad8f-daa6184d661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a85ab5-5f10-4372-8c81-d9c7d7dbb50a', 'volume_name': 'volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c801398-b87d-476a-9f6f-3d143f83278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c801398-b87d-476a-9f6f-3d143f83278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5baa85-68cd-43a8-bc14-e38c17bc4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Volume 83a85ab5-5f10-4372-8c81-d9c7d7dbb50a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a', 'volume_size': 1}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1309709063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a85ab5-5f10-4372-8c81-d9c7d7dbb50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fd83d75ea44968b861f68cc737eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:37:53Z,use_quota=True,user_id='c63e064fba6e4439aa51537e541f4e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Creating volume 83a85ab5-5f10-4372-8c81-d9c7d7dbb50a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:37:53 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "cinder-1b5daeca-2c22-4dc9-9604-7870a232159a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-1b5daeca-2c22-4dc9-9604-7870a232159a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:53 devstack sudo[87146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a 1073741824
Apr 15 14:37:53 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e572a-258f-4d53-8227-40943250ceaf]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:53 devstack sudo[87150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a
Apr 15 14:37:53 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5f80377a-43ce-4a45-aaae-dfc4babd5859 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5f80377a-43ce-4a45-aaae-dfc4babd5859 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5f80377a-43ce-4a45-aaae-dfc4babd5859 tempest-VolumesActionsTest-1661868918 None] Volume detach called, but volume not attached.
Apr 15 14:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5f80377a-43ce-4a45-aaae-dfc4babd5859 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:54 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a 1073741824" returned: 0 in 0.631s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:54 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a
Apr 15 14:37:54 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:54 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:54 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a
Apr 15 14:37:54 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "cinder-quobyte-accb96f0-7a4d-4075-989f-9b780020f74e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-quobyte-accb96f0-7a4d-4075-989f-9b780020f74e" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c9bbb-366d-40b1-87b2-b0176b520984]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:54 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b5daeca-2c22-4dc9-9604-7870a232159a" returned: 0 in 0.533s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-quobyte-1b5daeca-2c22-4dc9-9604-7870a232159a" released by "delete_volume" :: held 1.154s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Created reservations ['7248340a-5961-496a-b8a3-6e0490043c9c', '6d83704b-353d-4e48-95e1-a10299644f7a', 'acf3bd3d-73bd-46be-a4f1-75211eb98c90', '187def12-987f-4ab8-be6f-d632a7ee181d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:54 devstack sudo[87170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e
Apr 15 14:37:54 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:54 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a" returned: 0 in 0.675s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:54 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:54 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5baa85-68cd-43a8-bc14-e38c17bc4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c71c84-7f83-404f-84bd-5817dcf54bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:37:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Volume volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a (83a85ab5-5f10-4372-8c81-d9c7d7dbb50a): created successfully
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c71c84-7f83-404f-84bd-5817dcf54bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Flow 'volume_create_manager' (4c696207-b6e1-4439-afa9-b90d464bacfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:37:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7396499d-0a6b-4977-a293-13c75f5c7c5d tempest-VolumesTransfersTest-1853001114 None] Created volume successfully.
Apr 15 14:37:55 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:55 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Deleted volume successfully.
Apr 15 14:37:55 devstack sudo[87179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e
Apr 15 14:37:55 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca0b1a84-c0af-4e05-a221-6be67031e986 tempest-SnapshotsActionsTest-1494671639 None] Lock "cinder-1b5daeca-2c22-4dc9-9604-7870a232159a-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:55 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-accb96f0-7a4d-4075-989f-9b780020f74e" returned: 0 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-quobyte-accb96f0-7a4d-4075-989f-9b780020f74e" released by "delete_volume" :: held 1.034s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Created reservations ['fa68e3f0-b02c-402e-bed6-e9edcc788360', '5f510e35-c483-442b-9a5d-1c2df810e072', 'd84ea62a-030f-4d02-ac20-7e3150838798', 'af2c13b0-e678-4848-a25a-b29611f9b4e1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:55 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:55 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ed8e7a63-cb4c-4c76-ac76-c34b7230ef7c tempest-VolumesTransfersTest-129231989 None] Transfer volume completed successfully.
Apr 15 14:37:56 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:56 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Deleted volume successfully.
Apr 15 14:37:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f71b0541-9178-470a-a502-64bc13ffdff9 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-accb96f0-7a4d-4075-989f-9b780020f74e-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Acquiring lock "cinder-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Acquiring lock "cinder-quobyte-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:37:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-quobyte-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:37:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ea515-009a-434a-8900-b3391cca1282]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:37:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:57 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a
Apr 15 14:37:57 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:58 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a" returned: 0 in 0.710s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:58 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a
Apr 15 14:37:58 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:59 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a" returned: 0 in 0.925s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-quobyte-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a" released by "delete_volume" :: held 1.662s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Created reservations ['f2e78f93-a57c-42da-9f8b-6710f9886d35', '43016de6-7f79-4245-8070-c19c93bbe8e7', 'dcf50783-8f8a-441b-bd1c-89570371c224', '9774faea-0742-41fd-893f-a4ee7e5e0f1d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:37:59 devstack sudo[87247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:37:59 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:37:59 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.725s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:37:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Deleted volume successfully.
Apr 15 14:37:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e7066bd6-3f81-4e04-8580-bf0968b89729 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-83a85ab5-5f10-4372-8c81-d9c7d7dbb50a-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Flow 'volume_create_manager' (9dba828e-6145-463a-af96-8bfa3f788c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b5d0c0-f3ca-4477-abfb-752464dad5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b5d0c0-f3ca-4477-abfb-752464dad5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-667668274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2810cfa0-17ad-4e75-808b-e5c055746eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fd83d75ea44968b861f68cc737eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:00Z,use_quota=True,user_id='c63e064fba6e4439aa51537e541f4e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39c21b4-2d1b-408a-b8a9-eb6b8f4ee6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39c21b4-2d1b-408a-b8a9-eb6b8f4ee6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5972d35-5237-4e8a-b525-3d91c2fb891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5972d35-5237-4e8a-b525-3d91c2fb891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2810cfa0-17ad-4e75-808b-e5c055746eb4', 'volume_name': 'volume-2810cfa0-17ad-4e75-808b-e5c055746eb4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01767d29-ea02-408f-a37d-bb28326171f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01767d29-ea02-408f-a37d-bb28326171f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf0a58a-cf5c-43e3-9d66-2f0ca9e3a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:00 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Volume 2810cfa0-17ad-4e75-808b-e5c055746eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2810cfa0-17ad-4e75-808b-e5c055746eb4', 'volume_size': 1}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-667668274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2810cfa0-17ad-4e75-808b-e5c055746eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fd83d75ea44968b861f68cc737eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:00Z,use_quota=True,user_id='c63e064fba6e4439aa51537e541f4e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Creating volume 2810cfa0-17ad-4e75-808b-e5c055746eb4 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:00 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:00 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 1073741824
Apr 15 14:38:00 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:00 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 1073741824" returned: 0 in 0.765s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:01 devstack sudo[87261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4
Apr 15 14:38:01 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:01 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf0a58a-cf5c-43e3-9d66-2f0ca9e3a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2810cfa0-17ad-4e75-808b-e5c055746eb4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7213e-84a1-4eee-806c-922c0eeac44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:01 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Volume volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 (2810cfa0-17ad-4e75-808b-e5c055746eb4): created successfully
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7213e-84a1-4eee-806c-922c0eeac44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Flow 'volume_create_manager' (9dba828e-6145-463a-af96-8bfa3f788c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-133e6c39-f552-47c4-8b31-c2040b8719af tempest-VolumesTransfersTest-1853001114 None] Created volume successfully.
Apr 15 14:38:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Acquiring lock "cinder-2810cfa0-17ad-4e75-808b-e5c055746eb4-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-2810cfa0-17ad-4e75-808b-e5c055746eb4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Acquiring lock "cinder-quobyte-2810cfa0-17ad-4e75-808b-e5c055746eb4" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-quobyte-2810cfa0-17ad-4e75-808b-e5c055746eb4" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d79cd7-3ec4-44a6-a092-5eecf7832672]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:02 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4
Apr 15 14:38:02 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:03 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4" returned: 0 in 0.763s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:03 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4
Apr 15 14:38:03 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:03 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2810cfa0-17ad-4e75-808b-e5c055746eb4" returned: 0 in 0.527s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-quobyte-2810cfa0-17ad-4e75-808b-e5c055746eb4" released by "delete_volume" :: held 1.341s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Created reservations ['8fb5ea0f-b1c4-4932-bb16-45d8dd36494c', '5bfc0539-0d18-4e13-819d-4a628132868c', '07ce4558-168f-4d4c-9cd2-587a7c06447b', 'b4b12d70-fce3-4f19-867c-0f35a96bd39e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:03 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:03 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:04 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.672s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:04 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Deleted volume successfully.
Apr 15 14:38:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef24c1e1-f897-404c-98a2-f663cab42bc0 tempest-VolumesTransfersTest-1299029921 None] Lock "cinder-2810cfa0-17ad-4e75-808b-e5c055746eb4-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (e4da6f61-e4c0-46b5-b5f8-4a8d76104574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355be4b2-0818-4f24-9e6a-7ed5494240ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355be4b2-0818-4f24-9e6a-7ed5494240ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1044944566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8aee3cf-8c54-42e9-908b-367202cfde27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:05Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e451d027-f7a9-4439-bd11-ff1266b68eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e451d027-f7a9-4439-bd11-ff1266b68eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb31a36e-34ac-42bb-9e35-10d03467e917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb31a36e-34ac-42bb-9e35-10d03467e917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8aee3cf-8c54-42e9-908b-367202cfde27', 'volume_name': 'volume-f8aee3cf-8c54-42e9-908b-367202cfde27', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54dd009-cc6d-4996-a37b-a1fb60588e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54dd009-cc6d-4996-a37b-a1fb60588e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce0afa6-300d-40a1-a0c8-c343b5bcd8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Volume f8aee3cf-8c54-42e9-908b-367202cfde27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8aee3cf-8c54-42e9-908b-367202cfde27', 'volume_size': 1}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1044944566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8aee3cf-8c54-42e9-908b-367202cfde27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:05Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Creating volume f8aee3cf-8c54-42e9-908b-367202cfde27 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:05 devstack sudo[87324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27 1073741824
Apr 15 14:38:05 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:06 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27 1073741824" returned: 0 in 0.778s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:06 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27
Apr 15 14:38:06 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Flow 'volume_create_manager' (22f5913f-5cc2-4385-a017-7dcbc4fb8823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfb7559-0222-4907-bff2-4f87cf5bc08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfb7559-0222-4907-bff2-4f87cf5bc08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-621209414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cb2814c19548f5bbb8166fb69ed0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:07Z,use_quota=True,user_id='194a7c573ed94eb4a242256594add7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be86f3d-984b-40a2-9573-8d3c5d0ed172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be86f3d-984b-40a2-9573-8d3c5d0ed172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971e7783-d567-4b00-b1ec-e5bdecf60d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971e7783-d567-4b00-b1ec-e5bdecf60d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83', 'volume_name': 'volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67e1afe-73dd-468e-9fa1-0a7bbee4eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67e1afe-73dd-468e-9fa1-0a7bbee4eac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61531f63-911c-43d3-9e73-c0fbfa6f3015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Volume a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83', 'volume_size': 1}
Apr 15 14:38:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:07 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27" returned: 0 in 1.029s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-621209414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cb2814c19548f5bbb8166fb69ed0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:07Z,use_quota=True,user_id='194a7c573ed94eb4a242256594add7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Creating volume a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce0afa6-300d-40a1-a0c8-c343b5bcd8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8aee3cf-8c54-42e9-908b-367202cfde27', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:07 devstack sudo[87334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 1073741824
Apr 15 14:38:07 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6ceb84-5de6-4fce-85e0-3add102965eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Volume volume-f8aee3cf-8c54-42e9-908b-367202cfde27 (f8aee3cf-8c54-42e9-908b-367202cfde27): created successfully
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6ceb84-5de6-4fce-85e0-3add102965eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (e4da6f61-e4c0-46b5-b5f8-4a8d76104574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-769ffbcd-0dfc-4f1f-824f-7b51be7f2456 tempest-VolumesActionsTest-1661868918 None] Created volume successfully.
Apr 15 14:38:07 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 1073741824" returned: 0 in 0.711s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:07 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83
Apr 15 14:38:07 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:08 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83" returned: 0 in 0.587s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61531f63-911c-43d3-9e73-c0fbfa6f3015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b807f97-21f0-4d09-b0b7-31625f38356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Volume volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 (a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83): created successfully
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b807f97-21f0-4d09-b0b7-31625f38356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Flow 'volume_create_manager' (22f5913f-5cc2-4385-a017-7dcbc4fb8823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c1b302ac-d9fd-4ddb-8cf0-a9d045a815d5 tempest-VolumeQuotasAdminTestJSON-777738521 None] Created volume successfully.
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-f8aee3cf-8c54-42e9-908b-367202cfde27-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-f8aee3cf-8c54-42e9-908b-367202cfde27-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-quobyte-f8aee3cf-8c54-42e9-908b-367202cfde27" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-f8aee3cf-8c54-42e9-908b-367202cfde27" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297c247-8258-4a82-bf1d-866e1b0d6333]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:08 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27
Apr 15 14:38:08 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "cinder-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "cinder-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "cinder-quobyte-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "cinder-quobyte-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0330ef-8616-4aca-8494-625bb9132c6b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:09 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83
Apr 15 14:38:09 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:09 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:09 devstack sudo[87379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27
Apr 15 14:38:09 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:09 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:09 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8aee3cf-8c54-42e9-908b-367202cfde27" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:09 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-f8aee3cf-8c54-42e9-908b-367202cfde27" released by "delete_volume" :: held 1.240s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:09 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Flow 'volume_create_manager' (6825f7a6-9781-4bed-81c5-a1f48decad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8641d11b-8b63-4b70-bcec-94e3159c24bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8641d11b-8b63-4b70-bcec-94e3159c24bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1853566766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e4c82b-9599-4fad-977a-d6a7338a172b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723d8d90b34c4a88ad54eba2b8841ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:10Z,use_quota=True,user_id='cd787b84ce374741a4b1499baf1e2124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80420470-cf54-4a5e-a5bd-eb976647241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80420470-cf54-4a5e-a5bd-eb976647241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87938f7c-1477-48d3-a294-65ac8bf31ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.image.glance [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Created reservations ['672d1e22-fb10-45d4-ac4f-6b7e324faf20', '2cd2f459-02be-481b-848c-8d50cf8f1fd1', '4a47c329-db76-465b-bd46-ec6014d20598', '6a2fb924-8a49-45f3-916a-3a93a6a3fcd7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:10 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:10 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87938f7c-1477-48d3-a294-65ac8bf31ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8e4c82b-9599-4fad-977a-d6a7338a172b', 'volume_name': 'volume-f8e4c82b-9599-4fad-977a-d6a7338a172b', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4bad6f9a0>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c2f81-5552-4760-a6af-43c0c472cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c2f81-5552-4760-a6af-43c0c472cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e357e6-8a5d-461f-8700-37847d5a3f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:10 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Volume f8e4c82b-9599-4fad-977a-d6a7338a172b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8e4c82b-9599-4fad-977a-d6a7338a172b', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4bad6f9a0>}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Trying to clone f8e4c82b-9599-4fad-977a-d6a7338a172b from image 87fa765b-69f0-4eaa-9650-38ed64870330 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 14:38:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-dbf9d140-67b0-4929-a525-c23dfb55b54e tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Terminate volume connection completed successfully.
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-dbf9d140-67b0-4929-a525-c23dfb55b54e tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Deleting attachment 06195364-500e-40b2-b425-1246df1189bb. {{(pid=83037) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 14:38:10 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 14:38:10 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "cinder-quobyte-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83" released by "delete_volume" :: held 1.187s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f59e8db-70ee-42c0-9854-8ac192990f6e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Created reservations ['3aecdb02-cff2-4acc-b75c-012d72f621a8', 'a656a19e-6e31-4e92-92b8-ddad1a9ae1bc', '37ed2919-b19f-4456-88aa-d7e3a8511896', '798cf084-1fdf-4873-98f3-39bff7e7c9ca'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:10 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:10 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:10 devstack sudo[87394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:10 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:10 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Deleted volume successfully.
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2ad0614-93e7-4cd2-a398-62964e582811 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-f8aee3cf-8c54-42e9-908b-367202cfde27-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "cinder-d3a1d0d4-b47a-4eec-b077-1047b23024ba-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-d3a1d0d4-b47a-4eec-b077-1047b23024ba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "cinder-quobyte-d3a1d0d4-b47a-4eec-b077-1047b23024ba" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-quobyte-d3a1d0d4-b47a-4eec-b077-1047b23024ba" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[000e5ad6-7c7f-4851-b4ba-85219d7d2900]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:10 devstack sudo[87397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:38:10 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:10 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:10 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 is fetched for user cd787b84ce374741a4b1499baf1e2124. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 14:38:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Deleted volume successfully.
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-74428341-b191-4eae-a8a7-943130dd4029 tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "cinder-a4adfb20-12f4-4e4f-aa6b-9c03dfb76d83-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b6ffe-3c69-4c00-abc4-5a101d1e0cb8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:11 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD
Apr 15 14:38:11 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (f1f69ae8-bbb6-4b99-b484-f77e5d2deb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ba31eb-4e48-42f6-a78b-3202419a062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ba31eb-4e48-42f6-a78b-3202419a062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1309783832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2723b41f-3edb-42f0-943c-431222245d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:11Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d57ff4-6480-405f-a44d-ba6c47ab96c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d57ff4-6480-405f-a44d-ba6c47ab96c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7fe3aa-35b5-415e-a1c8-ae8b2ad040ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7fe3aa-35b5-415e-a1c8-ae8b2ad040ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2723b41f-3edb-42f0-943c-431222245d2e', 'volume_name': 'volume-2723b41f-3edb-42f0-943c-431222245d2e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52914fa0-324b-47d8-90b1-e4c019077c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52914fa0-324b-47d8-90b1-e4c019077c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81e6935-ca87-4948-89de-ba56f2fa48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Volume 2723b41f-3edb-42f0-943c-431222245d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2723b41f-3edb-42f0-943c-431222245d2e', 'volume_size': 1}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1309783832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2723b41f-3edb-42f0-943c-431222245d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:11Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Creating volume 2723b41f-3edb-42f0-943c-431222245d2e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:11 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:11 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e 1073741824
Apr 15 14:38:11 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:11 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 0 in 0.631s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:11 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:38:11 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Flow 'volume_create_manager' (e73b1ea5-5f09-4cf0-9287-8f7eaca51827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2518e-2b84-4e5b-817e-caebd7e27ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2518e-2b84-4e5b-817e-caebd7e27ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-430865088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4647836f-0fba-4e3d-8ead-f863a70ae937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cb2814c19548f5bbb8166fb69ed0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:12Z,use_quota=True,user_id='194a7c573ed94eb4a242256594add7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decf83fa-9c4c-4783-a76f-7bfe9f869ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decf83fa-9c4c-4783-a76f-7bfe9f869ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b351997a-6c6b-40f5-89b1-f99dc318fceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b351997a-6c6b-40f5-89b1-f99dc318fceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4647836f-0fba-4e3d-8ead-f863a70ae937', 'volume_name': 'volume-4647836f-0fba-4e3d-8ead-f863a70ae937', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e268c96-1eff-46e4-b690-214079099600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e268c96-1eff-46e4-b690-214079099600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579181d5-3927-4415-a50d-7dd9a2ad6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Volume 4647836f-0fba-4e3d-8ead-f863a70ae937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4647836f-0fba-4e3d-8ead-f863a70ae937', 'volume_size': 1}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:11 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e 1073741824" returned: 0 in 0.705s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:11 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e
Apr 15 14:38:11 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:11 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 1 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:11 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba
Apr 15 14:38:11 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:12 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-430865088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4647836f-0fba-4e3d-8ead-f863a70ae937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cb2814c19548f5bbb8166fb69ed0b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:12Z,use_quota=True,user_id='194a7c573ed94eb4a242256594add7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Creating volume 4647836f-0fba-4e3d-8ead-f863a70ae937 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:12 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81e6935-ca87-4948-89de-ba56f2fa48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2723b41f-3edb-42f0-943c-431222245d2e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02d81e0-b97a-4e8c-80be-8c0b10d2a5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:12 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937 1073741824
Apr 15 14:38:12 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Volume volume-2723b41f-3edb-42f0-943c-431222245d2e (2723b41f-3edb-42f0-943c-431222245d2e): created successfully
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02d81e0-b97a-4e8c-80be-8c0b10d2a5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (f1f69ae8-bbb6-4b99-b484-f77e5d2deb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-832ef68a-f33c-4737-881c-ed00886d89f6 tempest-VolumesActionsTest-1661868918 None] Created volume successfully.
Apr 15 14:38:12 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d3a1d0d4-b47a-4eec-b077-1047b23024ba" returned: 0 in 0.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-quobyte-d3a1d0d4-b47a-4eec-b077-1047b23024ba" released by "delete_volume" :: held 1.652s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.quota [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Created reservations ['da2f8303-7404-4171-9192-a31a5e406607', '606b6e43-356a-448c-a9b2-8cbc708a0a41', '5fa75d29-7661-44a0-a28a-e6dfaa1910ed', 'b032836e-9af1-4af2-9d71-fb5f1a8f7bb8'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:12 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:12 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:12 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:12 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937 1073741824" returned: 0 in 0.584s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.manager [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Deleted volume successfully.
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-a2f0bc0c-7671-4df6-bb50-25ac91542b93 req-d65f28e4-b72a-413c-81f3-c43cbf1fb4bb tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-d3a1d0d4-b47a-4eec-b077-1047b23024ba-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:12 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937
Apr 15 14:38:12 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-2723b41f-3edb-42f0-943c-431222245d2e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Lock "cinder-2723b41f-3edb-42f0-943c-431222245d2e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-quobyte-2723b41f-3edb-42f0-943c-431222245d2e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-2723b41f-3edb-42f0-943c-431222245d2e" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[33749c87-405d-49ff-8e5c-4be5a1a81114]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:13 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937" returned: 0 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.745s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1853566766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e4c82b-9599-4fad-977a-d6a7338a172b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723d8d90b34c4a88ad54eba2b8841ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:10Z,use_quota=True,user_id='cd787b84ce374741a4b1499baf1e2124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Creating volume f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:13 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579181d5-3927-4415-a50d-7dd9a2ad6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4647836f-0fba-4e3d-8ead-f863a70ae937', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:13 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 1073741824
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23713777-7971-462b-bd7b-1eccd414deb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:13 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Volume volume-4647836f-0fba-4e3d-8ead-f863a70ae937 (4647836f-0fba-4e3d-8ead-f863a70ae937): created successfully
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23713777-7971-462b-bd7b-1eccd414deb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:13 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e
Apr 15 14:38:13 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Flow 'volume_create_manager' (e73b1ea5-5f09-4cf0-9287-8f7eaca51827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e3a216de-7699-4539-8271-d59fff887dce tempest-VolumeQuotasAdminTestJSON-777738521 None] Created volume successfully.
Apr 15 14:38:13 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:13 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e
Apr 15 14:38:13 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:13 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 1073741824" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:14 devstack sudo[87450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:14 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-780c50b2-6072-4f25-88d6-377029d03e5f tempest-VolumeQuotasAdminTestJSON-363872324 None] Transfer volume completed successfully.
Apr 15 14:38:14 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2723b41f-3edb-42f0-943c-431222245d2e" returned: 0 in 0.487s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-2723b41f-3edb-42f0-943c-431222245d2e" released by "delete_volume" :: held 1.112s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:14 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Created reservations ['22fc94c8-162b-472a-a422-077cc4ad175b', '6a8b4772-15f2-4258-8181-9bea919114f8', 'cfd6ac42-4f08-4e66-b0a0-d4d49e05566c', 'bbe1a863-56fb-4369-ae76-6ef8f5362b59'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 0 in 0.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Attempting download of 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume f8e4c82b-9599-4fad-977a-d6a7338a172b. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96dbe1-782d-41c3-8ecb-4078c94b062c]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:14 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:14 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:14 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r
Apr 15 14:38:14 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:14 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.441s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Deleted volume successfully.
Apr 15 14:38:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de8d3a20-42f4-4532-8004-e33d265c472b tempest-VolumesActionsTest-1765062541 None] Lock "cinder-2723b41f-3edb-42f0-943c-431222245d2e-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Acquiring lock "cinder-4647836f-0fba-4e3d-8ead-f863a70ae937-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Lock "cinder-4647836f-0fba-4e3d-8ead-f863a70ae937-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:15 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Acquiring lock "cinder-quobyte-4647836f-0fba-4e3d-8ead-f863a70ae937" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Lock "cinder-quobyte-4647836f-0fba-4e3d-8ead-f863a70ae937" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b2133-8bfb-4562-9082-02e67dd3917d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:15 devstack sudo[87468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r
Apr 15 14:38:15 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:15 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937
Apr 15 14:38:15 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:15 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:15 devstack sudo[87496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937
Apr 15 14:38:15 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:15 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (6d8424ab-43f1-45dd-a4ad-3fda3c317bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af54b87-b642-434f-a1b3-d1438f64edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af54b87-b642-434f-a1b3-d1438f64edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874185304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e12450-dcf8-43f5-98c2-b506e7638cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:16Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4060f0e-4b0c-4bab-a823-2e6f5295a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4060f0e-4b0c-4bab-a823-2e6f5295a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550961e-20e7-4a22-9996-37dbe00f1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550961e-20e7-4a22-9996-37dbe00f1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e12450-dcf8-43f5-98c2-b506e7638cd2', 'volume_name': 'volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd583ca3-7a60-4d63-aa92-230c74613f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd583ca3-7a60-4d63-aa92-230c74613f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10d27f4-c208-4061-8122-759224382c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Volume e7e12450-dcf8-43f5-98c2-b506e7638cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2', 'volume_size': 1}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874185304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e12450-dcf8-43f5-98c2-b506e7638cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:16Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Creating volume e7e12450-dcf8-43f5-98c2-b506e7638cd2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:15 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r" returned: 1 in 0.824s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_owefk80r' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b8afb-3207-4122-9373-9ce985c628cc]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:15 devstack sudo[87498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 1073741824
Apr 15 14:38:15 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:15 devstack sudo[87499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD
Apr 15 14:38:15 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:16 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4647836f-0fba-4e3d-8ead-f863a70ae937" returned: 0 in 0.502s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Lock "cinder-quobyte-4647836f-0fba-4e3d-8ead-f863a70ae937" released by "delete_volume" :: held 1.141s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Created reservations ['44feb3b1-88f5-4441-bc06-45241b48a5ea', '35b9db99-1b51-4acc-bd10-0a3e70239701', '315427d4-b5d5-4b64-9747-a3a4789e5dcc', 'c20c9dd7-51ea-4d74-800d-a8801af07175'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:16 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:16 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:16 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:16 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] 87fa765b-69f0-4eaa-9650-38ed64870330 was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 1073741824" returned: 0 in 0.565s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:16 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:16 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:16 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2
Apr 15 14:38:16 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:17 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:17 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.665s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Deleted volume successfully.
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10d27f4-c208-4061-8122-759224382c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f705d2-a02e-42c8-9f35-11086d97aa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Volume volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 (e7e12450-dcf8-43f5-98c2-b506e7638cd2): created successfully
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f705d2-a02e-42c8-9f35-11086d97aa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (6d8424ab-43f1-45dd-a4ad-3fda3c317bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c9fc212b-4bf3-43ac-902e-7c977fc606fa tempest-VolumeQuotasAdminTestJSON-1590180182 None] Lock "cinder-4647836f-0fba-4e3d-8ead-f863a70ae937-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-43268ee3-5eb1-402f-9024-cc9161a6e993 tempest-VolumesActionsTest-1661868918 None] Created volume successfully.
Apr 15 14:38:17 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 0 in 1.051s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_k47tqlxbdevstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:38:17 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Converted 112.00 MB image at 106.32 MB/s
Apr 15 14:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:17 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 1G
Apr 15 14:38:17 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:18 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 1G" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f94859-683c-43e3-8bed-eff43f79d7ed]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-e7e12450-dcf8-43f5-98c2-b506e7638cd2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-e7e12450-dcf8-43f5-98c2-b506e7638cd2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:18 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:18 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-quobyte-e7e12450-dcf8-43f5-98c2-b506e7638cd2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-e7e12450-dcf8-43f5-98c2-b506e7638cd2" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7972f7-aaed-4b04-9cec-7df4e3e5fb87]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:18 devstack sudo[87543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2
Apr 15 14:38:18 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:18 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 0 in 0.596s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:18 devstack sudo[87547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:18 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:18 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2" returned: 0 in 0.633s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:18 devstack sudo[87552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2
Apr 15 14:38:18 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:19 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 1 in 0.636s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Downloaded image 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume f8e4c82b-9599-4fad-977a-d6a7338a172b successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 for user cd787b84ce374741a4b1499baf1e2124 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Marking volume f8e4c82b-9599-4fad-977a-d6a7338a172b as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Copying metadata from image 87fa765b-69f0-4eaa-9650-38ed64870330 to f8e4c82b-9599-4fad-977a-d6a7338a172b. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Creating volume glance metadata for volume f8e4c82b-9599-4fad-977a-d6a7338a172b backed by image 87fa765b-69f0-4eaa-9650-38ed64870330 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 14:38:19 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e7e12450-dcf8-43f5-98c2-b506e7638cd2" returned: 0 in 0.522s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-e7e12450-dcf8-43f5-98c2-b506e7638cd2" released by "delete_volume" :: held 1.198s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e357e6-8a5d-461f-8700-37847d5a3f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e4c82b-9599-4fad-977a-d6a7338a172b', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4bad6f9a0>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57a20a8-fdc1-4237-a91c-1d16f51a329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Volume volume-f8e4c82b-9599-4fad-977a-d6a7338a172b (f8e4c82b-9599-4fad-977a-d6a7338a172b): created successfully
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57a20a8-fdc1-4237-a91c-1d16f51a329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Flow 'volume_create_manager' (6825f7a6-9781-4bed-81c5-a1f48decad58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-048e8059-dfca-4eba-8e47-b41743e9701e tempest-VolumesExtendTest-2083954741 None] Created volume successfully.
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Created reservations ['3086ea70-5506-46d6-bbf3-9e2f1c8b78b3', '59883716-b9fe-46f5-97e9-1fb748ee43a2', 'dea57fbb-3978-4e05-9c02-df4b5d171dd1', '934c0583-ac2a-456f-843f-3cc0cab3e3b4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:19 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:19 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:20 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.474s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Deleted volume successfully.
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0a23f1d-1094-427c-87e7-9d958fd30323 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-e7e12450-dcf8-43f5-98c2-b506e7638cd2-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b931bba8-1893-42ae-a53e-d84dec03712d]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (9b9bc3ca-f9fa-4109-a63d-ee08e0d3286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac247d38-0f60-4d98-8f5f-d53cbc69a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac247d38-0f60-4d98-8f5f-d53cbc69a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-642475727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1177538-2e55-4f4c-ade2-ef621f244457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:21Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:20 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:20 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25af03ed-800a-4bb8-86fe-f039142d0db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25af03ed-800a-4bb8-86fe-f039142d0db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50ccc3-80d4-4bd2-adb3-966c373b090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50ccc3-80d4-4bd2-adb3-966c373b090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1177538-2e55-4f4c-ade2-ef621f244457', 'volume_name': 'volume-c1177538-2e55-4f4c-ade2-ef621f244457', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd92987b-6ff3-4265-8829-5095a385383e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd92987b-6ff3-4265-8829-5095a385383e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c20d1c8-2203-42cd-bb2a-34112360a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Volume c1177538-2e55-4f4c-ade2-ef621f244457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1177538-2e55-4f4c-ade2-ef621f244457', 'volume_size': 1}
Apr 15 14:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:21 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:21 devstack sudo[87566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:21 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:21 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 1 in 0.671s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 2G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b 2G" returned: 0 in 0.052s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.338s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-642475727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1177538-2e55-4f4c-ade2-ef621f244457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:21Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Creating volume c1177538-2e55-4f4c-ade2-ef621f244457 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:21 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457 1073741824
Apr 15 14:38:22 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-93526c67-da71-49fd-b288-f70a5d27d8a9 tempest-VolumesExtendTest-2083954741 None] Extend volume completed successfully.
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Flow 'volume_create_manager' (43420731-8c21-4875-b1f7-4cd69206ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038bf4c9-45de-4c13-b189-e83c1d3ba327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038bf4c9-45de-4c13-b189-e83c1d3ba327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1904386189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04270859-6d24-4a4f-852e-5b5409d47780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823ec62ffb444291adb5c900eff01ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:22Z,use_quota=True,user_id='0e40db62133b483b8367457498730534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7862fc6-ee5b-4af2-834c-a1dfa4944e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7862fc6-ee5b-4af2-834c-a1dfa4944e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e604a3-a3b2-4447-a348-4eeeafb61bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e604a3-a3b2-4447-a348-4eeeafb61bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04270859-6d24-4a4f-852e-5b5409d47780', 'volume_name': 'volume-04270859-6d24-4a4f-852e-5b5409d47780', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfa5492-66e5-4708-8a31-0d08e02e2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfa5492-66e5-4708-8a31-0d08e02e2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824d9afe-8b56-443f-992c-6191ab36dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Volume 04270859-6d24-4a4f-852e-5b5409d47780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04270859-6d24-4a4f-852e-5b5409d47780', 'volume_size': 1}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:22 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457 1073741824" returned: 0 in 0.516s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:22 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457
Apr 15 14:38:22 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:22 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457" returned: 0 in 0.433s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1904386189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04270859-6d24-4a4f-852e-5b5409d47780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823ec62ffb444291adb5c900eff01ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:22Z,use_quota=True,user_id='0e40db62133b483b8367457498730534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Creating volume 04270859-6d24-4a4f-852e-5b5409d47780 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:22 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c20d1c8-2203-42cd-bb2a-34112360a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1177538-2e55-4f4c-ade2-ef621f244457', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21da0f8e-b869-43b8-834d-d6db7e694b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:22 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780 1073741824
Apr 15 14:38:22 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-f8e4c82b-9599-4fad-977a-d6a7338a172b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Volume volume-c1177538-2e55-4f4c-ade2-ef621f244457 (c1177538-2e55-4f4c-ade2-ef621f244457): created successfully
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21da0f8e-b869-43b8-834d-d6db7e694b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (9b9bc3ca-f9fa-4109-a63d-ee08e0d3286f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-f8e4c82b-9599-4fad-977a-d6a7338a172b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a36a5a83-9eac-4770-8b17-6b3cca9620ee tempest-VolumesActionsTest-1661868918 None] Created volume successfully.
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-quobyte-f8e4c82b-9599-4fad-977a-d6a7338a172b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-f8e4c82b-9599-4fad-977a-d6a7338a172b" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a13baab-f25a-4cbe-9f4c-e2a736081472]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:23 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:23 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:23 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780 1073741824" returned: 0 in 0.621s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:23 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780
Apr 15 14:38:23 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:23 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:23 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:23 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:24 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824d9afe-8b56-443f-992c-6191ab36dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04270859-6d24-4a4f-852e-5b5409d47780', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8928ce-9a76-47af-b77b-a56c43d97900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:24 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Volume volume-04270859-6d24-4a4f-852e-5b5409d47780 (04270859-6d24-4a4f-852e-5b5409d47780): created successfully
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8928ce-9a76-47af-b77b-a56c43d97900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Flow 'volume_create_manager' (43420731-8c21-4875-b1f7-4cd69206ac80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:24 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-c1177538-2e55-4f4c-ade2-ef621f244457-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e8463f32-1e4f-45a9-9454-95b20664465d tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Created volume successfully.
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 1 in 0.539s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-c1177538-2e55-4f4c-ade2-ef621f244457-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:24 devstack sudo[87629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b
Apr 15 14:38:24 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-e332e26e-6915-426c-bab1-fffe4d4b7d9f tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Terminate volume connection completed successfully.
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-e332e26e-6915-426c-bab1-fffe4d4b7d9f tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Deleting attachment bee9433d-7b0c-4c18-bf81-bfb3c9961a4e. {{(pid=83037) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "cinder-quobyte-c1177538-2e55-4f4c-ade2-ef621f244457" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-c1177538-2e55-4f4c-ade2-ef621f244457" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9934f26a-3047-42c7-8669-d6c1e46d5d44]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:24 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457
Apr 15 14:38:24 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:24 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8e4c82b-9599-4fad-977a-d6a7338a172b" returned: 0 in 0.489s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-f8e4c82b-9599-4fad-977a-d6a7338a172b" released by "delete_volume" :: held 1.626s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Created reservations ['ff5cc366-90ed-40dc-8ba5-3fa51fdb5913', '01e3dd15-fab3-4309-964d-d0b3f1329fce', 'e45d507d-699d-4b78-b5da-a48f5af146e4', 'fe3d553f-91ef-4350-b67c-d0353bce9154'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:24 devstack sudo[87637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:24 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "cinder-de0b385a-3db3-4526-aabd-c8bcdcd1fa32-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:24 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-de0b385a-3db3-4526-aabd-c8bcdcd1fa32-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "cinder-quobyte-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:24 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457
Apr 15 14:38:24 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-quobyte-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[519d3382-6146-4461-a684-6b0f0dc2f717]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Acquiring lock "cinder-04270859-6d24-4a4f-852e-5b5409d47780-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "cinder-04270859-6d24-4a4f-852e-5b5409d47780-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Acquiring lock "cinder-quobyte-04270859-6d24-4a4f-852e-5b5409d47780" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "cinder-quobyte-04270859-6d24-4a4f-852e-5b5409d47780" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b94ba6-e05a-4b80-a7ff-1a341c963dbd]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:25 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32
Apr 15 14:38:25 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:25 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780
Apr 15 14:38:25 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:25 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.592s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Deleted volume successfully.
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cf014534-fe74-4ea3-98c5-07fd7ac0dd60 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-f8e4c82b-9599-4fad-977a-d6a7338a172b-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:25 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c1177538-2e55-4f4c-ade2-ef621f244457" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-quobyte-c1177538-2e55-4f4c-ade2-ef621f244457" released by "delete_volume" :: held 1.263s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Created reservations ['510b89bc-5fc2-4f57-842c-ee89e314f2f1', 'a5dfebd0-dff6-4db6-b061-98c384b3c03e', '4c4292cd-b1f9-4254-a508-395dd4878a00', '4a3ec582-4430-463c-803d-bd99c3e97a01'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Flow 'volume_create_manager' (17f0e6dd-7bbe-4082-bf47-2406ff71be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb17f0cd-b77b-4637-b5b9-9e27f040b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb17f0cd-b77b-4637-b5b9-9e27f040b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1174232903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30676e67-d6c3-4dab-9da7-75c13552112d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723d8d90b34c4a88ad54eba2b8841ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:26Z,use_quota=True,user_id='cd787b84ce374741a4b1499baf1e2124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a789df-7d98-447c-834c-efe71f76ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a789df-7d98-447c-834c-efe71f76ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecae101e-bb24-483d-b0e7-c479a931a37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecae101e-bb24-483d-b0e7-c479a931a37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30676e67-d6c3-4dab-9da7-75c13552112d', 'volume_name': 'volume-30676e67-d6c3-4dab-9da7-75c13552112d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7351387e-d9a1-4862-8e8d-37ff8c4bec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7351387e-d9a1-4862-8e8d-37ff8c4bec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37036795-ea9f-4057-8d5b-754b658ae173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Volume 30676e67-d6c3-4dab-9da7-75c13552112d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30676e67-d6c3-4dab-9da7-75c13552112d', 'volume_size': 1}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1174232903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30676e67-d6c3-4dab-9da7-75c13552112d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723d8d90b34c4a88ad54eba2b8841ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:26Z,use_quota=True,user_id='cd787b84ce374741a4b1499baf1e2124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Creating volume 30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:25 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:25 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:25 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d 1073741824
Apr 15 14:38:25 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:25 devstack sudo[87654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780
Apr 15 14:38:25 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:25 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:25 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:25 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" returned: 0 in 0.815s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:25 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32
Apr 15 14:38:25 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:26 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-04270859-6d24-4a4f-852e-5b5409d47780" returned: 0 in 0.464s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "cinder-quobyte-04270859-6d24-4a4f-852e-5b5409d47780" released by "delete_volume" :: held 1.143s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Created reservations ['031b1029-7b1f-4e6c-896a-8ae89d9be311', 'fc416b6e-dd19-41d0-9e31-aa37bfa2b44d', 'ac1b190f-f30c-48cb-87e8-11a3842666b1', 'd27b2c11-a2cd-4dd7-a356-a47d684c7bec'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:26 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.498s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:26 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Deleted volume successfully.
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d 1073741824" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:26 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d
Apr 15 14:38:26 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-85f4e166-1a3d-4f0d-b1dc-821104cc4ef4 tempest-VolumesActionsTest-1765062541 None] Lock "cinder-c1177538-2e55-4f4c-ade2-ef621f244457-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:26 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:26 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:26 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-quobyte-de0b385a-3db3-4526-aabd-c8bcdcd1fa32" released by "delete_volume" :: held 1.435s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.quota [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Created reservations ['9ecb8965-a8b6-4ad0-b4bd-cd02503e7fa3', '4057f821-f3d3-4385-abe5-e936e9dadd6f', '6224731f-baee-4050-8147-caceff0d32e8', '964cc935-34e2-4f21-bad1-8e2544a0e279'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:26 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:26 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (20ecbcfe-fa99-4378-820f-cfc0c241daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199bbae6-aedd-4b80-8262-c54a65d1a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199bbae6-aedd-4b80-8262-c54a65d1a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217505854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117f0ef7-1dc6-4617-991b-6585c314f370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:27Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bfff41-8b22-495a-8307-486a7137f02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bfff41-8b22-495a-8307-486a7137f02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1f120e-e3a0-44cb-b33f-237a984590bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1f120e-e3a0-44cb-b33f-237a984590bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117f0ef7-1dc6-4617-991b-6585c314f370', 'volume_name': 'volume-117f0ef7-1dc6-4617-991b-6585c314f370', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf3d098-8131-4f14-b11e-063bb216a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf3d098-8131-4f14-b11e-063bb216a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ee39a1-3b95-4220-b61b-c3b3ea0e3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Volume 117f0ef7-1dc6-4617-991b-6585c314f370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117f0ef7-1dc6-4617-991b-6585c314f370', 'volume_size': 1}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:26 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d" returned: 0 in 0.527s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217505854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117f0ef7-1dc6-4617-991b-6585c314f370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9642d74eff4734a8befe465b24db01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:27Z,use_quota=True,user_id='0ce6b7c0b18b480cb2874190ca95d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Creating volume 117f0ef7-1dc6-4617-991b-6585c314f370 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37036795-ea9f-4057-8d5b-754b658ae173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30676e67-d6c3-4dab-9da7-75c13552112d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:26 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370 1073741824
Apr 15 14:38:26 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdcaa28-af49-4177-8a54-3541d0e37e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Volume volume-30676e67-d6c3-4dab-9da7-75c13552112d (30676e67-d6c3-4dab-9da7-75c13552112d): created successfully
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdcaa28-af49-4177-8a54-3541d0e37e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Flow 'volume_create_manager' (17f0e6dd-7bbe-4082-bf47-2406ff71be44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c2f99168-d752-4384-8448-17e29cdb5f5d tempest-VolumesExtendTest-2083954741 None] Created volume successfully.
Apr 15 14:38:26 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Deleted volume successfully.
Apr 15 14:38:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1c11d46-a344-47fc-82a0-e8447242cc4a tempest-VolumeQuotasNegativeTestJSON-1496828230 None] Lock "cinder-04270859-6d24-4a4f-852e-5b5409d47780-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:27 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.659s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.manager [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Deleted volume successfully.
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-6336fe5c-2ae4-4e68-9207-da1c54074dc5 req-dd01c33b-2aa0-45ee-97ad-b02468f84ea4 tempest-ServerBootFromVolumeStableRescueTest-1877319634 None] Lock "cinder-de0b385a-3db3-4526-aabd-c8bcdcd1fa32-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:27 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370 1073741824" returned: 0 in 0.515s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:27 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370
Apr 15 14:38:27 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:27 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ee39a1-3b95-4220-b61b-c3b3ea0e3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117f0ef7-1dc6-4617-991b-6585c314f370', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994f224d-c75f-46d6-adf8-0fb138b13a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Volume volume-117f0ef7-1dc6-4617-991b-6585c314f370 (117f0ef7-1dc6-4617-991b-6585c314f370): created successfully
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994f224d-c75f-46d6-adf8-0fb138b13a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Flow 'volume_create_manager' (20ecbcfe-fa99-4378-820f-cfc0c241daec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Creating offline snapshot 0f1c8857-8d0a-4316-91cf-f37e6a408a3f of volume 30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:38:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-62c323de-ea39-4e1f-9990-0d8b03e15899 tempest-VolumesActionsTest-1661868918 None] Created volume successfully.
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c21b8d-3198-4d7f-85bb-9ef7e062d65f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:28 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d
Apr 15 14:38:28 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:28 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d" returned: 0 in 0.616s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:28 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f 1G
Apr 15 14:38:28 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:29 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f 1G" returned: 0 in 0.610s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30676e67-d6c3-4dab-9da7-75c13552112d -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:29 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30676e67-d6c3-4dab-9da7-75c13552112d -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f
Apr 15 14:38:29 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "cinder-117f0ef7-1dc6-4617-991b-6585c314f370-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-117f0ef7-1dc6-4617-991b-6585c314f370-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "cinder-quobyte-117f0ef7-1dc6-4617-991b-6585c314f370" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-quobyte-117f0ef7-1dc6-4617-991b-6585c314f370" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad519df-4366-4952-85d1-dfe9178c5fa0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:29 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370
Apr 15 14:38:29 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:29 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30676e67-d6c3-4dab-9da7-75c13552112d -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f" returned: 0 in 0.872s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:29 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f is being set with open permissions: ugo+rw
Apr 15 14:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:30 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f
Apr 15 14:38:30 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:30 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370" returned: 0 in 0.567s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:30 devstack sudo[87736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370
Apr 15 14:38:30 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:30 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f" returned: 0 in 0.584s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:30 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:30 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info
Apr 15 14:38:30 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-117f0ef7-1dc6-4617-991b-6585c314f370" returned: 0 in 0.453s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-quobyte-117f0ef7-1dc6-4617-991b-6585c314f370" released by "delete_volume" :: held 1.073s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Created reservations ['f4393d6b-fa1d-4920-b63c-9752756a6290', 'cafcb870-2372-4245-a4ff-fe6e5eddf132', 'ecb931ff-e651-4d8e-806f-4fe7d9af18be', '3700c3ca-711c-4c8e-a984-12e9ad174e0a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:30 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:30 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:31 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info" returned: 0 in 0.577s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:31 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info is being set with open permissions: ugo+rw
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:31 devstack sudo[87749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info
Apr 15 14:38:31 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Flow 'volume_create_manager' (5ba61ae5-76d8-4133-8921-06b6e823358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a17768-b082-4a71-ab7c-f1c9f02280ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a17768-b082-4a71-ab7c-f1c9f02280ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-552944571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ae22a0-0259-48a8-877c-362d25d39bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f96d8ac64a147a8bf00c8be3b4ca960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:31Z,use_quota=True,user_id='598d823e75a84b83b1ad04094e0853a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:31 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1988bda1-894d-4857-8aa2-a46c772d7bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1988bda1-894d-4857-8aa2-a46c772d7bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb76a48-2541-4139-a9bf-509cce4d741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb76a48-2541-4139-a9bf-509cce4d741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ae22a0-0259-48a8-877c-362d25d39bae', 'volume_name': 'volume-94ae22a0-0259-48a8-877c-362d25d39bae', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727d791b-45ad-4c47-9560-16c2c4540b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727d791b-45ad-4c47-9560-16c2c4540b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3665d1ce-4147-46f9-a54f-619a7b876f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Volume 94ae22a0-0259-48a8-877c-362d25d39bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ae22a0-0259-48a8-877c-362d25d39bae', 'volume_size': 1}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Deleted volume successfully.
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca46e8a2-ea17-4fd4-9cda-2ddaffb2e276 tempest-VolumesActionsTest-1661868918 None] Lock "cinder-117f0ef7-1dc6-4617-991b-6585c314f370-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:31 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.info" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.808s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-552944571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ae22a0-0259-48a8-877c-362d25d39bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f96d8ac64a147a8bf00c8be3b4ca960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:31Z,use_quota=True,user_id='598d823e75a84b83b1ad04094e0853a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Creating volume 94ae22a0-0259-48a8-877c-362d25d39bae {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:31 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:31 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae 1073741824
Apr 15 14:38:31 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-54833666-ba18-4494-b250-95727a23df3b tempest-VolumesExtendTest-2083954741 None] Create snapshot completed successfully
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:32 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae 1073741824" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:32 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae
Apr 15 14:38:32 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:32 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.663s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3665d1ce-4147-46f9-a54f-619a7b876f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ae22a0-0259-48a8-877c-362d25d39bae', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5b6bdf-ce23-440d-aea4-6575ac61bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[17144a2a-7789-4871-8858-82b58cf24b50]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Volume volume-94ae22a0-0259-48a8-877c-362d25d39bae (94ae22a0-0259-48a8-877c-362d25d39bae): created successfully
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5b6bdf-ce23-440d-aea4-6575ac61bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Flow 'volume_create_manager' (5ba61ae5-76d8-4133-8921-06b6e823358b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d9083488-f493-4190-b329-da4de4d3b51d tempest-VolumesServicesTestJSON-506138646 None] Created volume successfully.
Apr 15 14:38:32 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d
Apr 15 14:38:32 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:33 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d" returned: 0 in 0.577s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f 2G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f 2G" returned: 0 in 0.097s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.705s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-01a87c46-1558-4baf-90e3-b6d3e218d776 tempest-VolumesExtendTest-2083954741 None] Extend volume completed successfully.
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Acquiring lock "cinder-94ae22a0-0259-48a8-877c-362d25d39bae-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Lock "cinder-94ae22a0-0259-48a8-877c-362d25d39bae-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Acquiring lock "cinder-quobyte-94ae22a0-0259-48a8-877c-362d25d39bae" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Lock "cinder-quobyte-94ae22a0-0259-48a8-877c-362d25d39bae" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c79b8-4dc9-411d-867c-5884bc5cbb7d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:33 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae
Apr 15 14:38:33 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:34 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae" returned: 0 in 0.623s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:34 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae
Apr 15 14:38:34 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-0f1c8857-8d0a-4316-91cf-f37e6a408a3f-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-0f1c8857-8d0a-4316-91cf-f37e6a408a3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-quobyte-30676e67-d6c3-4dab-9da7-75c13552112d" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-30676e67-d6c3-4dab-9da7-75c13552112d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-quobyte-0f1c8857-8d0a-4316-91cf-f37e6a408a3f" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-0f1c8857-8d0a-4316-91cf-f37e6a408a3f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Deleting offline snapshot 0f1c8857-8d0a-4316-91cf-f37e6a408a3f of volume 30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] snapshot_file for this snap is: volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[52634782-d490-49ce-a06b-7488d218e9b9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:34 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f
Apr 15 14:38:34 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:34 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94ae22a0-0259-48a8-877c-362d25d39bae" returned: 0 in 0.504s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Lock "cinder-quobyte-94ae22a0-0259-48a8-877c-362d25d39bae" released by "delete_volume" :: held 1.182s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Created reservations ['5f98d925-e6d6-4e27-bcf6-8ddc8b7bd8ae', 'e9c3c07d-5dd8-4ba5-b507-5158e5a171fc', '2bb8e800-c2f2-4f5d-abdf-c7ab35e75eab', '33bf6587-c8bf-47f6-a850-ee2132a23478'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:34 devstack sudo[87782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:34 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:35 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f" returned: 0 in 0.616s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30676e67-d6c3-4dab-9da7-75c13552112d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[713ebced-7c53-4f3f-96d1-ae51acf83aff]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:35 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d
Apr 15 14:38:35 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:35 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.458s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Deleted volume successfully.
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b14a3ac-8adb-482a-956a-ee2502e9768a tempest-VolumesServicesTestJSON-506138646 None] Lock "cinder-94ae22a0-0259-48a8-877c-362d25d39bae-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:35 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:35 devstack sudo[87794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f
Apr 15 14:38:35 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:36 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:36 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f
Apr 15 14:38:36 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:36 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d.0f1c8857-8d0a-4316-91cf-f37e6a408a3f" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-0f1c8857-8d0a-4316-91cf-f37e6a408a3f" released by "_delete_snapshot" :: held 2.389s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-30676e67-d6c3-4dab-9da7-75c13552112d" released by "delete_snapshot" :: held 2.399s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Created reservations ['e1cfb3f0-8026-4e96-922c-adf34050a30c', '1a03b6d5-fbf9-4ae3-83de-543ecd35d6ba', '802a749a-658c-42eb-a1b6-36cebbd000a1', '3b2be2e5-644a-452a-ad49-2d631c019a3d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Delete snapshot completed successfully.
Apr 15 14:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f5bc9fa-1edf-4d19-b41d-c951c8f28f58 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-0f1c8857-8d0a-4316-91cf-f37e6a408a3f-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-30676e67-d6c3-4dab-9da7-75c13552112d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-30676e67-d6c3-4dab-9da7-75c13552112d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "cinder-quobyte-30676e67-d6c3-4dab-9da7-75c13552112d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-30676e67-d6c3-4dab-9da7-75c13552112d" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f21aca-6b2b-40f6-83ff-18048c07861a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:37 devstack sudo[87811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d
Apr 15 14:38:37 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:38 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d" returned: 0 in 0.683s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:38 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d
Apr 15 14:38:38 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:38 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30676e67-d6c3-4dab-9da7-75c13552112d" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-quobyte-30676e67-d6c3-4dab-9da7-75c13552112d" released by "delete_volume" :: held 1.224s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:38 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Created reservations ['e817e262-45be-4e6a-ad50-73efd58669db', '53f30d8a-efc9-46d3-9661-712d82c8523d', 'e868c7cd-fbb8-424e-950e-940a27c2f0b5', '55357da9-7e5c-4990-9ffb-0c9d27a21524'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:39 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:39 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:39 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Deleted volume successfully.
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=182,cinder:INSERT=75,cinder:UPDATE=220,cinder:DELETE=12 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:38:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ff5139fa-a5c0-40cd-a518-35fabc6ad4c1 tempest-VolumesExtendTest-2083954741 None] Lock "cinder-30676e67-d6c3-4dab-9da7-75c13552112d-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=161,cinder:UPDATE=231,cinder:INSERT=44,cinder:DELETE=23 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Flow 'volume_create_manager' (ae067b55-e018-4977-901d-3cd04128094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e8559c-27d9-4398-b276-33204eb1e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e8559c-27d9-4398-b276-33204eb1e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553154114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0586f051-4f64-4076-8791-bacb986092a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e68d87662d14970aeefc355d6aa17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:42Z,use_quota=True,user_id='3075cca6cf784cbf816e478c49ab9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05bffe0-9aa5-4fbb-a8d0-d90367919923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05bffe0-9aa5-4fbb-a8d0-d90367919923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b8a88c-95da-48e3-9fd1-b8baa937c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b8a88c-95da-48e3-9fd1-b8baa937c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0586f051-4f64-4076-8791-bacb986092a7', 'volume_name': 'volume-0586f051-4f64-4076-8791-bacb986092a7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e803aa64-ae05-435f-9894-fdd8be111465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e803aa64-ae05-435f-9894-fdd8be111465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf2e2e2-2800-4330-96a8-2edb973e2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Volume 0586f051-4f64-4076-8791-bacb986092a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0586f051-4f64-4076-8791-bacb986092a7', 'volume_size': 1}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553154114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0586f051-4f64-4076-8791-bacb986092a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e68d87662d14970aeefc355d6aa17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:42Z,use_quota=True,user_id='3075cca6cf784cbf816e478c49ab9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Creating volume 0586f051-4f64-4076-8791-bacb986092a7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:41 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:41 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7 1073741824
Apr 15 14:38:41 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Flow 'volume_create_manager' (b6fac740-ee68-4f23-a27f-8307f952e29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb203cef-4ce1-4819-ac53-c0d64f41b0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb203cef-4ce1-4819-ac53-c0d64f41b0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-26892156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f334c44-5b70-40ff-be30-4ca45a54531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24439e4c02c4e34b13c7f88fa236190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:42Z,use_quota=True,user_id='c6765e732bbb4abaa19552081a2c5dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa254d4e-a821-4fa0-9b4e-27d76e95374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa254d4e-a821-4fa0-9b4e-27d76e95374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88b18ec-eac7-447a-aee8-e8e6d7c9122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88b18ec-eac7-447a-aee8-e8e6d7c9122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f334c44-5b70-40ff-be30-4ca45a54531b', 'volume_name': 'volume-3f334c44-5b70-40ff-be30-4ca45a54531b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b84f05b-e718-455b-a744-fd301e29c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b84f05b-e718-455b-a744-fd301e29c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c7cfaa-24de-478d-b923-f110fd7b7635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Volume 3f334c44-5b70-40ff-be30-4ca45a54531b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f334c44-5b70-40ff-be30-4ca45a54531b', 'volume_size': 1}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:42 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7 1073741824" returned: 0 in 0.608s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:42 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7
Apr 15 14:38:42 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Flow 'volume_create_manager' (70a16602-4cf3-4f20-a3c1-b7cd3c5afe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e867f26-0199-4f46-b7c1-cbefffe6a48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e867f26-0199-4f46-b7c1-cbefffe6a48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-793913551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ecaf4e7a645feaa6fbb3575865d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:43Z,use_quota=True,user_id='323ee8e8ba3440d0b65e76ae205bffe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6afa6db-ebc6-4d17-b259-34be4a768058),volume_type_id=c6afa6db-ebc6-4d17-b259-34be4a768058)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f56dc22-d325-483d-825a-130813b87608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f56dc22-d325-483d-825a-130813b87608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9693b90-2d3f-4a96-8dc7-d4df8011679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9693b90-2d3f-4a96-8dc7-d4df8011679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec', 'volume_name': 'volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafa7a77-90e9-4d6a-9c6b-1cfde81dd653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafa7a77-90e9-4d6a-9c6b-1cfde81dd653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618e23b1-eae8-4bdb-9e98-1f208adcfe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:42 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Volume c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec', 'volume_size': 1}
Apr 15 14:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:43 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-26892156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f334c44-5b70-40ff-be30-4ca45a54531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24439e4c02c4e34b13c7f88fa236190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:42Z,use_quota=True,user_id='c6765e732bbb4abaa19552081a2c5dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Creating volume 3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:43 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf2e2e2-2800-4330-96a8-2edb973e2330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0586f051-4f64-4076-8791-bacb986092a7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:43 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b 1073741824
Apr 15 14:38:43 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ab726f-313d-479f-ade9-380fcf451fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Volume volume-0586f051-4f64-4076-8791-bacb986092a7 (0586f051-4f64-4076-8791-bacb986092a7): created successfully
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ab726f-313d-479f-ade9-380fcf451fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Flow 'volume_create_manager' (ae067b55-e018-4977-901d-3cd04128094c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4796d577-1a3d-4588-87b6-d7938ec899f0 tempest-VolumesListAdminTestJSON-740289412 None] Created volume successfully.
Apr 15 14:38:43 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b 1073741824" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:43 devstack sudo[87836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b
Apr 15 14:38:43 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:44 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b" returned: 0 in 0.555s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-793913551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ecaf4e7a645feaa6fbb3575865d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:43Z,use_quota=True,user_id='323ee8e8ba3440d0b65e76ae205bffe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6afa6db-ebc6-4d17-b259-34be4a768058),volume_type_id=c6afa6db-ebc6-4d17-b259-34be4a768058)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Creating volume c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c7cfaa-24de-478d-b923-f110fd7b7635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f334c44-5b70-40ff-be30-4ca45a54531b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9135c8-0499-4686-9b97-c94dfca7f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:44 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec 1073741824
Apr 15 14:38:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Volume volume-3f334c44-5b70-40ff-be30-4ca45a54531b (3f334c44-5b70-40ff-be30-4ca45a54531b): created successfully
Apr 15 14:38:44 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9135c8-0499-4686-9b97-c94dfca7f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Flow 'volume_create_manager' (b6fac740-ee68-4f23-a27f-8307f952e29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-e678fbe1-8267-46c8-bc6b-6838d7b29460 req-ac52286e-45ce-45f3-b88d-2a2ce495604d tempest-VolumesSnapshotsTestJSON-1063166563 None] Created volume successfully.
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Flow 'volume_create_manager' (33f0ffdb-0aa2-4dc8-81b5-3defd6874290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24913060-0fbe-41d3-bde6-19517750eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24913060-0fbe-41d3-bde6-19517750eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1698805661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c484f3-e2a8-47c0-81c9-cfc6387d03ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e68d87662d14970aeefc355d6aa17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:44Z,use_quota=True,user_id='3075cca6cf784cbf816e478c49ab9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9521004b-0aac-475c-aad3-a0f9cc6846ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9521004b-0aac-475c-aad3-a0f9cc6846ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2371a1f-2424-4f46-8957-67878a056fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2371a1f-2424-4f46-8957-67878a056fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c484f3-e2a8-47c0-81c9-cfc6387d03ef', 'volume_name': 'volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad4de7-b5aa-4ea7-b643-e405f31385ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad4de7-b5aa-4ea7-b643-e405f31385ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8ca37-43ca-4c2a-80f9-1275e3619f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Volume a9c484f3-e2a8-47c0-81c9-cfc6387d03ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef', 'volume_size': 1}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:44 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec 1073741824" returned: 0 in 0.661s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:44 devstack sudo[87879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec
Apr 15 14:38:44 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Flow 'volume_create_manager' (210d9808-23b7-4787-9c00-b5d31add7eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddafbe6-eb7d-4dab-8808-c726659b4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddafbe6-eb7d-4dab-8808-c726659b4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2022545113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3defba18-e2aa-4db6-af13-9adcac613fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97604e089014afba6cb5309c2e7814e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:45Z,use_quota=True,user_id='5d04924383ad4c69b3b707ac2e235cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d99b592-bc77-48e8-be88-0783c44e6537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d99b592-bc77-48e8-be88-0783c44e6537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f293a1d-a1fb-4f16-948d-0c62646a4dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f293a1d-a1fb-4f16-948d-0c62646a4dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3defba18-e2aa-4db6-af13-9adcac613fe1', 'volume_name': 'volume-3defba18-e2aa-4db6-af13-9adcac613fe1', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac52dad-df69-4fd2-ad2c-c7bc3d7b0fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac52dad-df69-4fd2-ad2c-c7bc3d7b0fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a5fcef-594b-4acb-ba3c-de186d896b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Volume 3defba18-e2aa-4db6-af13-9adcac613fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3defba18-e2aa-4db6-af13-9adcac613fe1', 'volume_size': 2}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:45 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec" returned: 0 in 0.569s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1698805661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c484f3-e2a8-47c0-81c9-cfc6387d03ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e68d87662d14970aeefc355d6aa17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:44Z,use_quota=True,user_id='3075cca6cf784cbf816e478c49ab9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Creating volume a9c484f3-e2a8-47c0-81c9-cfc6387d03ef {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:45 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618e23b1-eae8-4bdb-9e98-1f208adcfe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c38b99-cb50-460f-9db4-fcdccbfb6283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:45 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef 1073741824
Apr 15 14:38:45 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Volume volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec (c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec): created successfully
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c38b99-cb50-460f-9db4-fcdccbfb6283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Flow 'volume_create_manager' (70a16602-4cf3-4f20-a3c1-b7cd3c5afe22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3f694825-a0b3-4c3e-b30d-0db8831a3730 tempest-VolumeTypesAccessTest-477938529 None] Created volume successfully.
Apr 15 14:38:45 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef 1073741824" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:45 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef
Apr 15 14:38:45 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Acquiring lock "cinder-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Lock "cinder-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Acquiring lock "cinder-quobyte-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Lock "cinder-quobyte-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66cd152-c3f0-484a-b00c-bf05baf5fe88]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:46 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec
Apr 15 14:38:46 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:46 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.501s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Creating offline snapshot 0faa027a-0d20-4d3c-88f6-d83cbf1a5125 of volume 3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8ca37-43ca-4c2a-80f9-1275e3619f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95307f5c-89c0-47f7-98a1-8f7ef33a346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7016484-d10d-4f39-a8e5-6c86e7365347]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Volume volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef (a9c484f3-e2a8-47c0-81c9-cfc6387d03ef): created successfully
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95307f5c-89c0-47f7-98a1-8f7ef33a346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Flow 'volume_create_manager' (33f0ffdb-0aa2-4dc8-81b5-3defd6874290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4718db10-14e3-44e0-90fa-1eef933348e9 tempest-VolumesListAdminTestJSON-740289412 None] Created volume successfully.
Apr 15 14:38:46 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b
Apr 15 14:38:46 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:46 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:46 devstack sudo[87897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec
Apr 15 14:38:46 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:46 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:46 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 1G
Apr 15 14:38:46 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:47 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec" returned: 0 in 0.412s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Lock "cinder-quobyte-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec" released by "delete_volume" :: held 0.932s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:47 devstack cinder-volume[83037]: WARNING cinder.quota [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1208448641 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1208448641, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:38:47 devstack cinder-volume[83037]: WARNING cinder.quota [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1208448641 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1208448641, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Created reservations ['2d088f94-42ea-494e-a7e3-9b0bd44893eb', 'd1c65631-3044-4253-9534-7051300b2764', '5516a128-664f-46f6-8c0c-77bef9be8b58', '57c40fa3-7a02-434d-aebd-45ebe9ad279f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:47 devstack sudo[87905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:47 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:47 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 1G" returned: 0 in 0.586s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f334c44-5b70-40ff-be30-4ca45a54531b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:47 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f334c44-5b70-40ff-be30-4ca45a54531b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125
Apr 15 14:38:47 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:47 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.553s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Deleted volume successfully.
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d115b0f-9b29-485c-9aca-5a3aa8a833c8 tempest-VolumeTypesAccessTest-477938529 None] Lock "cinder-c48ffcf4-66e3-43c4-9ae4-2c8bc6251eec-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Flow 'volume_create_manager' (615ae825-3531-4b55-9c38-c32b68cdc98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0452f829-24f3-40af-b4b8-00f3f066a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0452f829-24f3-40af-b4b8-00f3f066a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2136302498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e68d87662d14970aeefc355d6aa17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:48Z,use_quota=True,user_id='3075cca6cf784cbf816e478c49ab9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772d5e20-3266-4a42-85e5-d7ea43a7a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772d5e20-3266-4a42-85e5-d7ea43a7a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2f752a-d5c9-4195-89ca-3420f6d1e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2f752a-d5c9-4195-89ca-3420f6d1e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040', 'volume_name': 'volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee764d4e-9fa6-404a-a911-67075673617d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee764d4e-9fa6-404a-a911-67075673617d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd746b37-73f4-4239-8e5b-8ecca959b121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Volume d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040', 'volume_size': 1}
Apr 15 14:38:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:48 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f334c44-5b70-40ff-be30-4ca45a54531b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125" returned: 0 in 0.529s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:48 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 is being set with open permissions: ugo+rw
Apr 15 14:38:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:48 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125
Apr 15 14:38:48 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:48 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125" returned: 0 in 0.436s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:48 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info
Apr 15 14:38:48 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:48 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info" returned: 0 in 0.475s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:48 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info is being set with open permissions: ugo+rw
Apr 15 14:38:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:48 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info
Apr 15 14:38:48 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:49 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.info" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.396s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2022545113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3defba18-e2aa-4db6-af13-9adcac613fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97604e089014afba6cb5309c2e7814e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:45Z,use_quota=True,user_id='5d04924383ad4c69b3b707ac2e235cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Creating volume 3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:49 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 2147483648 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:49 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 2147483648
Apr 15 14:38:49 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-22966601-6ad7-49b6-b0d9-bfd34e4da7ec req-ae190be0-098d-446c-a2db-4746edf4687e tempest-VolumesSnapshotsTestJSON-1063166563 None] Create snapshot completed successfully
Apr 15 14:38:49 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 2147483648" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:50 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1
Apr 15 14:38:50 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "cinder-0faa027a-0d20-4d3c-88f6-d83cbf1a5125-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-0faa027a-0d20-4d3c-88f6-d83cbf1a5125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "cinder-quobyte-3f334c44-5b70-40ff-be30-4ca45a54531b" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-quobyte-3f334c44-5b70-40ff-be30-4ca45a54531b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "cinder-quobyte-0faa027a-0d20-4d3c-88f6-d83cbf1a5125" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-quobyte-0faa027a-0d20-4d3c-88f6-d83cbf1a5125" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Deleting offline snapshot 0faa027a-0d20-4d3c-88f6-d83cbf1a5125 of volume 3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] snapshot_file for this snap is: volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f35927-f9e2-4957-bced-44cfacbee962]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:50 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2136302498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e68d87662d14970aeefc355d6aa17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:48Z,use_quota=True,user_id='3075cca6cf784cbf816e478c49ab9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Creating volume d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:50 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:50 devstack sudo[87934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a5fcef-594b-4acb-ba3c-de186d896b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3defba18-e2aa-4db6-af13-9adcac613fe1', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:50 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:50 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 1073741824
Apr 15 14:38:50 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1911e8-0b07-4867-9bcf-135b1f5bedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Volume volume-3defba18-e2aa-4db6-af13-9adcac613fe1 (3defba18-e2aa-4db6-af13-9adcac613fe1): created successfully
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1911e8-0b07-4867-9bcf-135b1f5bedc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Flow 'volume_create_manager' (210d9808-23b7-4787-9c00-b5d31add7eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-568f6441-82ff-4c2d-b094-79390d5e4c3d tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Created volume successfully.
Apr 15 14:38:50 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125" returned: 0 in 0.549s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f334c44-5b70-40ff-be30-4ca45a54531b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf7033-60d1-420c-ad57-84ca454da29d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:51 devstack sudo[87944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b
Apr 15 14:38:51 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:51 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 1073741824" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:51 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040
Apr 15 14:38:51 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:51 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:51 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125
Apr 15 14:38:51 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:51 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040" returned: 0 in 0.489s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.197s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Creating offline snapshot b8a94622-0f24-4b44-bee4-e0cde498caf9 of volume 3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd746b37-73f4-4239-8e5b-8ecca959b121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59336bb8-5482-4737-9f6e-4a7c21963936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b67ac-5948-4361-aa18-8b2e60af9f64]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:51 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Volume volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 (d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040): created successfully
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59336bb8-5482-4737-9f6e-4a7c21963936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Flow 'volume_create_manager' (615ae825-3531-4b55-9c38-c32b68cdc98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-18c7cbe9-24f7-4e82-9fd3-fd73e8af9aac tempest-VolumesListAdminTestJSON-740289412 None] Created volume successfully.
Apr 15 14:38:51 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1
Apr 15 14:38:51 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:52 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:52 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125
Apr 15 14:38:52 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:52 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 2G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:52 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 2G
Apr 15 14:38:52 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:52 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Flow 'volume_create_manager' (ad6f7c1f-1531-4b85-82ad-a5478fbdd6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788aa428-a1d5-4687-a877-c43e7632fc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b.0faa027a-0d20-4d3c-88f6-d83cbf1a5125" returned: 0 in 0.565s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788aa428-a1d5-4687-a877-c43e7632fc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c79bc6-5f53-4fb4-a536-5b80039ec9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='915b68b4ce9a4b149128d1da6c068975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:53Z,use_quota=True,user_id='f3173575ddfb47e0a0e0f4c9010ec642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b572c05-9676-4bb1-81d3-769ef8b4dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b572c05-9676-4bb1-81d3-769ef8b4dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c99c65-8f0c-46ad-9dab-e212fe691e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c99c65-8f0c-46ad-9dab-e212fe691e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c79bc6-5f53-4fb4-a536-5b80039ec9ab', 'volume_name': 'volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c90e1d1-9979-455d-900a-eb7602f4f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c90e1d1-9979-455d-900a-eb7602f4f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7dc7ce-8b0c-4a2f-892a-ddc0435e2df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:52 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Volume 92c79bc6-5f53-4fb4-a536-5b80039ec9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab', 'volume_size': 1}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-quobyte-0faa027a-0d20-4d3c-88f6-d83cbf1a5125" released by "_delete_snapshot" :: held 2.342s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-quobyte-3f334c44-5b70-40ff-be30-4ca45a54531b" released by "delete_snapshot" :: held 2.355s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.quota [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Created reservations ['ade863ea-b9fb-40ce-b978-4133cc7fe7e4', 'f4af7428-cbcd-43ed-a391-0609ccbdf808', 'c04b9d27-3a7b-46cb-b6c3-824178c91262', 'a1c957c1-bbd7-4983-8d5a-328530993a16'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Delete snapshot completed successfully.
Apr 15 14:38:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-bd4afca2-6216-40d3-a8ec-5e09242fce73 req-86c9be01-d71e-4a6f-a1ed-60aba66a35ce tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-0faa027a-0d20-4d3c-88f6-d83cbf1a5125-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:53 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 2G" returned: 0 in 0.668s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3defba18-e2aa-4db6-af13-9adcac613fe1 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:53 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3defba18-e2aa-4db6-af13-9adcac613fe1 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9
Apr 15 14:38:53 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:53 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3defba18-e2aa-4db6-af13-9adcac613fe1 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 is being set with open permissions: ugo+rw
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:53 devstack sudo[87976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9
Apr 15 14:38:53 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "cinder-3f334c44-5b70-40ff-be30-4ca45a54531b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-3f334c44-5b70-40ff-be30-4ca45a54531b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "cinder-quobyte-3f334c44-5b70-40ff-be30-4ca45a54531b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-quobyte-3f334c44-5b70-40ff-be30-4ca45a54531b" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea785253-74fb-4977-a3f1-ba41356a7919]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:53 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b
Apr 15 14:38:53 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:53 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9" returned: 0 in 0.504s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:54 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info
Apr 15 14:38:54 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:54 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b" returned: 0 in 0.526s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:54 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b
Apr 15 14:38:54 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:54 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:54 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info is being set with open permissions: ugo+rw
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:54 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info
Apr 15 14:38:54 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:54 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f334c44-5b70-40ff-be30-4ca45a54531b" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-quobyte-3f334c44-5b70-40ff-be30-4ca45a54531b" released by "delete_volume" :: held 1.068s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG cinder.quota [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Created reservations ['eacd3077-4b9c-4b01-b652-8bb7940f204a', 'c662158b-768d-41f2-a000-2538bc89333f', 'e6dbc8ea-dac0-4a37-a6fe-3c7270191f62', 'f823a35f-b417-41a2-a1c2-ceffca88c59f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:54 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:54 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:55 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.info" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.395s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.280s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c79bc6-5f53-4fb4-a536-5b80039ec9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='915b68b4ce9a4b149128d1da6c068975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:53Z,use_quota=True,user_id='f3173575ddfb47e0a0e0f4c9010ec642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Creating volume 92c79bc6-5f53-4fb4-a536-5b80039ec9ab {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:55 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:55 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab 1073741824
Apr 15 14:38:55 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-52748c06-e536-400c-9382-3b1d74937519 tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Create snapshot completed successfully
Apr 15 14:38:55 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.464s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.manager [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Deleted volume successfully.
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-961f02ff-312c-478c-a33c-e949d6b04d25 req-0bab0d21-55c1-4166-8547-f86a2d8a25dc tempest-VolumesSnapshotsTestJSON-1063166563 None] Lock "cinder-3f334c44-5b70-40ff-be30-4ca45a54531b-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:55 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab 1073741824" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:55 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "cinder-b8a94622-0f24-4b44-bee4-e0cde498caf9-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:55 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-b8a94622-0f24-4b44-bee4-e0cde498caf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "cinder-quobyte-3defba18-e2aa-4db6-af13-9adcac613fe1" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-quobyte-3defba18-e2aa-4db6-af13-9adcac613fe1" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "cinder-quobyte-b8a94622-0f24-4b44-bee4-e0cde498caf9" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-quobyte-b8a94622-0f24-4b44-bee4-e0cde498caf9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Deleting offline snapshot b8a94622-0f24-4b44-bee4-e0cde498caf9 of volume 3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] snapshot_file for this snap is: volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99ca30-ea67-4f33-8f7d-7bc6ae45e14b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:55 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9
Apr 15 14:38:55 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Flow 'volume_create_manager' (9dbfd131-3dd4-4263-a6fd-cd54a6d4d4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be93df7c-bb5e-4d43-904e-293587f911bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be93df7c-bb5e-4d43-904e-293587f911bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-147551750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86c98d5-ca42-4bbd-b876-97c1b78ed89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24191668e1c14afcb290bf46c4444fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:56Z,use_quota=True,user_id='57afcd603064409baaf63cdb6c832af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0acc6c4-c9b8-42f0-bf00-8e802ab64f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0acc6c4-c9b8-42f0-bf00-8e802ab64f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b531270-af2a-4d03-8986-3b7eb3915641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.image.glance [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 14:38:56 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7dc7ce-8b0c-4a2f-892a-ddc0435e2df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ba3de5-a125-4d4c-be6d-67dca99ba235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:56 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Volume volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab (92c79bc6-5f53-4fb4-a536-5b80039ec9ab): created successfully
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ba3de5-a125-4d4c-be6d-67dca99ba235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Flow 'volume_create_manager' (ad6f7c1f-1531-4b85-82ad-a5478fbdd6e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:38:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9119d7d9-cf94-4909-893f-5f6df1938b71 tempest-VolumesListAdminTestJSON-651496681 None] Created volume successfully.
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b531270-af2a-4d03-8986-3b7eb3915641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b86c98d5-ca42-4bbd-b876-97c1b78ed89f', 'volume_name': 'volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4b08c5510>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912fc2ac-d5fd-4695-9985-d22e386903c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912fc2ac-d5fd-4695-9985-d22e386903c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81ed333-f7ef-43cc-ab22-d61de2078712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:38:56 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Volume b86c98d5-ca42-4bbd-b876-97c1b78ed89f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4b08c5510>}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Trying to clone b86c98d5-ca42-4bbd-b876-97c1b78ed89f from image 87fa765b-69f0-4eaa-9650-38ed64870330 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 14:38:56 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3defba18-e2aa-4db6-af13-9adcac613fe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a21b8f-9a9d-4a14-a0c4-0d3132059334]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:56 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1
Apr 15 14:38:56 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 14:38:56 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933b5fa-adb2-4599-a24f-216743e7c47a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:56 devstack sudo[88012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD
Apr 15 14:38:56 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Acquiring lock "cinder-92c79bc6-5f53-4fb4-a536-5b80039ec9ab-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Lock "cinder-92c79bc6-5f53-4fb4-a536-5b80039ec9ab-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Acquiring lock "cinder-quobyte-92c79bc6-5f53-4fb4-a536-5b80039ec9ab" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Lock "cinder-quobyte-92c79bc6-5f53-4fb4-a536-5b80039ec9ab" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:57 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1" returned: 0 in 0.665s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbb71a1-0c96-4099-b1e0-b8f9a580df24]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9
Apr 15 14:38:57 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "cinder-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "cinder-quobyte-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-quobyte-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fb1767-4205-4173-a3a4-599023c075cb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD" returned: 0 in 0.654s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:57 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab
Apr 15 14:38:57 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 is fetched for user 57afcd603064409baaf63cdb6c832af9. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 14:38:57 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040
Apr 15 14:38:57 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[770acb6d-384e-4503-ab62-2abc7f72c3b4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD
Apr 15 14:38:57 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9" returned: 0 in 0.591s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9
Apr 15 14:38:57 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab
Apr 15 14:38:57 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-147551750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86c98d5-ca42-4bbd-b876-97c1b78ed89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24191668e1c14afcb290bf46c4444fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:38:56Z,use_quota=True,user_id='57afcd603064409baaf63cdb6c832af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Creating volume b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:38:57 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:57 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f 1073741824
Apr 15 14:38:57 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:57 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040" returned: 0 in 0.761s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:58 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040
Apr 15 14:38:58 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:58 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-92c79bc6-5f53-4fb4-a536-5b80039ec9ab" returned: 0 in 0.457s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Lock "cinder-quobyte-92c79bc6-5f53-4fb4-a536-5b80039ec9ab" released by "delete_volume" :: held 1.156s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Created reservations ['b5cf1bbf-7b2f-4563-9b1b-b5c168b7be57', '12403355-f191-406b-87fe-ac57731d1929', 'c51d46c8-7063-4445-95f8-4acf694c9e14', '6268b844-351f-4932-b086-3f1d426e03a1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:58 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1.b8a94622-0f24-4b44-bee4-e0cde498caf9" returned: 0 in 0.689s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:58 devstack sudo[88051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:58 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-quobyte-b8a94622-0f24-4b44-bee4-e0cde498caf9" released by "_delete_snapshot" :: held 2.648s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-quobyte-3defba18-e2aa-4db6-af13-9adcac613fe1" released by "delete_snapshot" :: held 2.661s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Created reservations ['171c0a30-cf36-45d5-8e0b-a2af934ed0ae', 'e02104f5-e0ab-446b-bcc2-6b5374d5e206', '03ff3765-7d46-4d00-a006-ed399988012e', 'e2315589-f59b-44d9-84ff-e8594ca0e0ea'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Delete snapshot completed successfully.
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4b760da5-df55-4e59-aab1-b2090e2d20ea tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-b8a94622-0f24-4b44-bee4-e0cde498caf9-delete_snapshot" released by "delete_snapshot" :: held 2.752s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:58 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040" returned: 0 in 0.610s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-quobyte-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040" released by "delete_volume" :: held 1.398s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:58 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f 1073741824" returned: 0 in 0.687s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Created reservations ['8905f64d-2924-45ba-8f7c-bd2edc161190', 'ac2625e0-2f2c-4314-adcb-8792da531535', 'c834ff86-6dd2-4b05-9863-c359a72ceee2', '2cd912f6-5a64-4780-9d53-526115a862b7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:58 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:38:58 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:58 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:38:58 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:58 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Deleted volume successfully.
Apr 15 14:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2701cdf5-a507-4314-aa12-d0a9f19b37db tempest-VolumesListAdminTestJSON-651496681 None] Lock "cinder-92c79bc6-5f53-4fb4-a536-5b80039ec9ab-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "cinder-3defba18-e2aa-4db6-af13-9adcac613fe1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-3defba18-e2aa-4db6-af13-9adcac613fe1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "cinder-quobyte-3defba18-e2aa-4db6-af13-9adcac613fe1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-quobyte-3defba18-e2aa-4db6-af13-9adcac613fe1" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a06b9-9e38-457e-b6c5-a2f5bddc2d69]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:59 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1
Apr 15 14:38:59 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:59 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 0 in 0.493s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-af29fcb9-7019-471d-ae48-6f56ab1c6062 tempest-BackendsCapabilitiesAdminTestsJSON-920143376 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6866645812988, 'free_capacity_gb': 1775.6866645812988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83037) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 14:38:59 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:38:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Deleted volume successfully.
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Attempting download of 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume b86c98d5-ca42-4bbd-b876-97c1b78ed89f. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e47b636-febe-4de7-a3dd-57dd2de0cd38 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-d1f4e0e7-dc6a-4d44-8b96-6e4e99e4f040-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8853669-c1ce-4047-aa92-7bf9f5c1eabd]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:59 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5
Apr 15 14:38:59 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "cinder-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "cinder-quobyte-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-quobyte-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef" acquired by "delete_volume" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[73235c7c-7121-4a2e-922b-58a25218d2a1]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:59 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef
Apr 15 14:38:59 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:59 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1" returned: 0 in 0.526s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:59 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1
Apr 15 14:38:59 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f17742f-f07f-4927-a4dd-0b89df104a3a tempest-BackendsCapabilitiesAdminTestsJSON-920143376 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6866645812988, 'free_capacity_gb': 1775.6866645812988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83037) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 15 14:38:59 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:59 devstack sudo[88077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5
Apr 15 14:38:59 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:38:59 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef" returned: 0 in 0.527s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:38:59 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef
Apr 15 14:38:59 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:00 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3defba18-e2aa-4db6-af13-9adcac613fe1" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-quobyte-3defba18-e2aa-4db6-af13-9adcac613fe1" released by "delete_volume" :: held 1.039s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Created reservations ['84327cfc-0565-4aee-98d4-133f98af19d6', '1b3b85a3-ac57-46f3-86e8-f4db0c6f8175', '492c6371-fc17-4c1b-a599-37f834dfadc0', '124609d4-730c-4a95-a94b-2ad82c25a377'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:00 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5" returned: 1 in 0.519s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_6m4cvwt5' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5d6061-68c2-4805-9e1d-d6ab54bd4dbb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:00 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:00 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:00 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD
Apr 15 14:39:00 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:00 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef" returned: 0 in 0.457s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-quobyte-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef" released by "delete_volume" :: held 1.008s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Created reservations ['2225c1d0-9d1f-42d7-8dc8-0f6171e1fefb', 'f341941c-c802-4331-b7a2-040335c353e0', '4b0ee440-fc5c-4f5c-a0f2-8c96c1132975', '0027c0a8-cda5-4685-865f-990de1b8c9ae'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:00 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:00 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "cinder-0586f051-4f64-4076-8791-bacb986092a7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-0586f051-4f64-4076-8791-bacb986092a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "cinder-quobyte-0586f051-4f64-4076-8791-bacb986092a7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-quobyte-0586f051-4f64-4076-8791-bacb986092a7" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f9c48b-7afc-4048-88a2-a84a9cf54cd4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:00 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7
Apr 15 14:39:00 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:00 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.607s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Deleted volume successfully.
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbfbabd9-7c54-4637-9b96-ed8038b08d3e tempest-VolumesSnapshotNegativeTestJSON-818958139 None] Lock "cinder-3defba18-e2aa-4db6-af13-9adcac613fe1-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:00 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] 87fa765b-69f0-4eaa-9650-38ed64870330 was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 14:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:00 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:39:00 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:01 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Deleted volume successfully.
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317207e6-c04e-4766-b63e-dbcc207d6b0b tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-a9c484f3-e2a8-47c0-81c9-cfc6387d03ef-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:01 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7" returned: 0 in 0.596s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:01 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7
Apr 15 14:39:01 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:01 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0586f051-4f64-4076-8791-bacb986092a7" returned: 0 in 0.555s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-quobyte-0586f051-4f64-4076-8791-bacb986092a7" released by "delete_volume" :: held 1.179s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Created reservations ['edc5ae47-d32c-44c7-9b8d-29d207384a18', '934fdecc-8b3f-4116-ba51-e7f26b013176', '55692ff7-df5d-48b0-a160-b3082862b285', '9adea343-ad88-4378-9a68-9d97a20995a3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:02 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:02 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:02 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 0 in 1.130s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_7vy1vp6zdevstack@QuobyteHD, size 112.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:39:02 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Converted 112.00 MB image at 98.88 MB/s
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:02 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f 1G
Apr 15 14:39:02 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:02 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Deleted volume successfully.
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-26ea9fff-009d-4a86-a6d6-62d726cb9512 tempest-VolumesListAdminTestJSON-740289412 None] Lock "cinder-0586f051-4f64-4076-8791-bacb986092a7-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:02 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f 1G" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4566a6-d69b-4f71-a2d7-0dae24e327ab]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:02 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:39:02 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:03 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:03 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:39:03 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (ef66d9bd-2f2d-4b1c-80ea-94a58c209287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9059ec81-96aa-4421-9c5a-645381a05604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9059ec81-96aa-4421-9c5a-645381a05604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-157423508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b26ba2b-a53c-45f5-b09b-fd874737b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:03Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d83185f-e8d1-49f2-8aed-baa9f0293da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d83185f-e8d1-49f2-8aed-baa9f0293da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9343137-2026-4b67-942d-b705992da3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9343137-2026-4b67-942d-b705992da3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b26ba2b-a53c-45f5-b09b-fd874737b88d', 'volume_name': 'volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c444de76-f429-42cc-8159-99dfaab4e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c444de76-f429-42cc-8159-99dfaab4e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda386b2-9710-480a-90c8-4a2c62742b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Volume 2b26ba2b-a53c-45f5-b09b-fd874737b88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d', 'volume_size': 1}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-157423508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b26ba2b-a53c-45f5-b09b-fd874737b88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:03Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Creating volume 2b26ba2b-a53c-45f5-b09b-fd874737b88d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:03 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:03 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d 1073741824
Apr 15 14:39:03 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (1f4d76f6-6b2d-4ae6-baa1-e6e5ae80d3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3c9d88-03d9-4296-b44a-914352d42112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3c9d88-03d9-4296-b44a-914352d42112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1423914933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280ca9ce-b81f-4c3a-8d6b-570ab28ef78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:04Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3c7249-7868-4eea-b439-61a9bab3bf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3c7249-7868-4eea-b439-61a9bab3bf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4591fc5-067d-4294-9eb1-364d27d42d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4591fc5-067d-4294-9eb1-364d27d42d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280ca9ce-b81f-4c3a-8d6b-570ab28ef78d', 'volume_name': 'volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2900ff0a-85d4-4f4c-b914-12dab8663f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2900ff0a-85d4-4f4c-b914-12dab8663f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e4adbb-4634-4025-a03c-f673d39081d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Volume 280ca9ce-b81f-4c3a-8d6b-570ab28ef78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d', 'volume_size': 1}
Apr 15 14:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:04 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 1 in 0.762s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Downloaded image 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume b86c98d5-ca42-4bbd-b876-97c1b78ed89f successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 for user 57afcd603064409baaf63cdb6c832af9 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Marking volume b86c98d5-ca42-4bbd-b876-97c1b78ed89f as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Copying metadata from image 87fa765b-69f0-4eaa-9650-38ed64870330 to b86c98d5-ca42-4bbd-b876-97c1b78ed89f. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Creating volume glance metadata for volume b86c98d5-ca42-4bbd-b876-97c1b78ed89f backed by image 87fa765b-69f0-4eaa-9650-38ed64870330 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81ed333-f7ef-43cc-ab22-d61de2078712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4b08c5510>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd99fb6e-6087-49f2-b7c0-911cbc207841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Volume volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f (b86c98d5-ca42-4bbd-b876-97c1b78ed89f): created successfully
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd99fb6e-6087-49f2-b7c0-911cbc207841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Flow 'volume_create_manager' (9dbfd131-3dd4-4263-a6fd-cd54a6d4d4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a7dbd80a-667c-4b78-a7b6-a21e69f8cbfc tempest-VolumesImageMetadata-461791514 None] Created volume successfully.
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (16b6970e-1b0e-4a4c-bf25-d9cd59e36aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f6914a-3187-4823-ad84-022a6620891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f6914a-3187-4823-ad84-022a6620891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308068883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b719b9-5df0-4403-8c1b-012c3e5bae45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:04Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816a80bc-fea3-485a-aada-8da9b0015604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816a80bc-fea3-485a-aada-8da9b0015604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405ee7f3-915a-44c6-8728-4572939bbfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405ee7f3-915a-44c6-8728-4572939bbfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b719b9-5df0-4403-8c1b-012c3e5bae45', 'volume_name': 'volume-30b719b9-5df0-4403-8c1b-012c3e5bae45', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71656f2e-a59d-4419-9958-49378f2a9dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71656f2e-a59d-4419-9958-49378f2a9dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd34b12-3c9b-4fe4-8a41-16a00b5ad78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Volume 30b719b9-5df0-4403-8c1b-012c3e5bae45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b719b9-5df0-4403-8c1b-012c3e5bae45', 'volume_size': 1}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:04 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d 1073741824" returned: 0 in 0.818s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:04 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d
Apr 15 14:39:04 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (94adf386-596f-4d69-993e-ede0cd3bd4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8045f13b-44c9-4507-bcf7-425bbc7f958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8045f13b-44c9-4507-bcf7-425bbc7f958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1655747862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812205a3-b0af-4c80-a90e-090ba7cbd67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:04Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e77027e-02bb-4d64-9952-5c076646f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e77027e-02bb-4d64-9952-5c076646f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b88e43c-e970-484f-911d-17cf5c544a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b88e43c-e970-484f-911d-17cf5c544a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812205a3-b0af-4c80-a90e-090ba7cbd67d', 'volume_name': 'volume-812205a3-b0af-4c80-a90e-090ba7cbd67d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4f7a35-311b-4e52-ba24-a3e924cad92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4f7a35-311b-4e52-ba24-a3e924cad92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fead9234-cea7-433c-9fdd-8d0ff214e5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Volume 812205a3-b0af-4c80-a90e-090ba7cbd67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812205a3-b0af-4c80-a90e-090ba7cbd67d', 'volume_size': 1}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Acquiring lock "cinder-b86c98d5-ca42-4bbd-b876-97c1b78ed89f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Lock "cinder-b86c98d5-ca42-4bbd-b876-97c1b78ed89f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Acquiring lock "cinder-quobyte-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Lock "cinder-quobyte-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6534320c-02a7-4c33-975d-806bb729d666]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (d32fa474-a550-4ebf-83af-4a73914d5ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce24abb5-19f5-4cec-9658-fc7c3d8eb3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce24abb5-19f5-4cec-9658-fc7c3d8eb3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026718334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bca19e-021d-4422-9612-43b333674669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:05Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbde5354-109b-4863-a101-d8b9fb74e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbde5354-109b-4863-a101-d8b9fb74e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a043ba-1e7e-4ba6-97d1-eb1a56618db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a043ba-1e7e-4ba6-97d1-eb1a56618db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bca19e-021d-4422-9612-43b333674669', 'volume_name': 'volume-75bca19e-021d-4422-9612-43b333674669', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985e192a-247f-416d-b7c9-e453a6b33609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985e192a-247f-416d-b7c9-e453a6b33609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98dd546-2088-480e-81b3-dca4c2aebee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Volume 75bca19e-021d-4422-9612-43b333674669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bca19e-021d-4422-9612-43b333674669', 'volume_size': 1}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:05 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:39:05 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:05 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d" returned: 0 in 0.777s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1423914933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280ca9ce-b81f-4c3a-8d6b-570ab28ef78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:04Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Creating volume 280ca9ce-b81f-4c3a-8d6b-570ab28ef78d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:05 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d 1073741824
Apr 15 14:39:05 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda386b2-9710-480a-90c8-4a2c62742b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d30568-5428-4e8f-b92d-e235d1705941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Volume volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d (2b26ba2b-a53c-45f5-b09b-fd874737b88d): created successfully
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d30568-5428-4e8f-b92d-e235d1705941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (ef66d9bd-2f2d-4b1c-80ea-94a58c209287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-79983153-3083-4b57-97fc-6632fa9f3785 tempest-CreateVolumesFromImageTest-429736176 None] Created volume successfully.
Apr 15 14:39:05 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 0 in 0.600s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:05 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:39:05 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:05 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d 1073741824" returned: 0 in 0.782s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:06 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d
Apr 15 14:39:06 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:06 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 1 in 0.680s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:06 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f
Apr 15 14:39:06 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:06 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308068883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b719b9-5df0-4403-8c1b-012c3e5bae45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:04Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Creating volume 30b719b9-5df0-4403-8c1b-012c3e5bae45 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:06 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e4adbb-4634-4025-a03c-f673d39081d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d2b4bb-a184-4fb8-80ed-f7698de3211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:06 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 1073741824
Apr 15 14:39:06 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Volume volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d (280ca9ce-b81f-4c3a-8d6b-570ab28ef78d): created successfully
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d2b4bb-a184-4fb8-80ed-f7698de3211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (1f4d76f6-6b2d-4ae6-baa1-e6e5ae80d3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c45385f5-0760-4f10-bd38-fcd59c709eda tempest-CreateVolumesFromImageTest-429736176 None] Created volume successfully.
Apr 15 14:39:06 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Lock "cinder-quobyte-b86c98d5-ca42-4bbd-b876-97c1b78ed89f" released by "delete_volume" :: held 1.946s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Created reservations ['c16118bf-8793-4f51-b017-850821c1f466', '3b0d529c-1d46-43ce-b111-29a54517c921', '8adf7a2d-c9e6-470b-b316-9e4661a7052b', 'dbc30dec-da84-430b-b5f4-5f12c9733dca'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:06 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:06 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:07 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 1073741824" returned: 0 in 0.700s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:07 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45
Apr 15 14:39:07 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:07 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.533s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Deleted volume successfully.
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e7a760f-9026-4ffc-95cc-8dda0ca1198b tempest-VolumesImageMetadata-461791514 None] Lock "cinder-b86c98d5-ca42-4bbd-b876-97c1b78ed89f-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:07 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.150s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1655747862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812205a3-b0af-4c80-a90e-090ba7cbd67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:04Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Creating volume 812205a3-b0af-4c80-a90e-090ba7cbd67d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd34b12-3c9b-4fe4-8a41-16a00b5ad78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b719b9-5df0-4403-8c1b-012c3e5bae45', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f4896-e1ce-4278-89e9-1eda2ad01f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:07 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d 1073741824
Apr 15 14:39:07 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Volume volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 (30b719b9-5df0-4403-8c1b-012c3e5bae45): created successfully
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2f4896-e1ce-4278-89e9-1eda2ad01f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (16b6970e-1b0e-4a4c-bf25-d9cd59e36aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cbb8486a-6343-4ce9-85da-4e3eae246584 tempest-CreateVolumesFromImageTest-429736176 None] Created volume successfully.
Apr 15 14:39:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ede0d9b6-8917-49f1-b73f-a5397dbf7967 tempest-GroupsTest-1895069065 None] Group tempest-Group1-387201669: creating
Apr 15 14:39:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ede0d9b6-8917-49f1-b73f-a5397dbf7967 tempest-GroupsTest-1895069065 None] Group tempest-Group1-387201669: created successfully
Apr 15 14:39:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ede0d9b6-8917-49f1-b73f-a5397dbf7967 tempest-GroupsTest-1895069065 None] Create group completed successfully.
Apr 15 14:39:08 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d 1073741824" returned: 0 in 0.810s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:08 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d
Apr 15 14:39:08 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:09 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.179s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026718334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bca19e-021d-4422-9612-43b333674669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616a02e010407685db8818fd4a762b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:05Z,use_quota=True,user_id='10c2c8bfdd1c46d692329e9182b52c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Creating volume 75bca19e-021d-4422-9612-43b333674669 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fead9234-cea7-433c-9fdd-8d0ff214e5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812205a3-b0af-4c80-a90e-090ba7cbd67d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:09 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669 1073741824
Apr 15 14:39:09 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609c2598-66b2-4416-a875-d2ee2164cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Volume volume-812205a3-b0af-4c80-a90e-090ba7cbd67d (812205a3-b0af-4c80-a90e-090ba7cbd67d): created successfully
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609c2598-66b2-4416-a875-d2ee2164cf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (94adf386-596f-4d69-993e-ede0cd3bd4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-076dbda3-ad90-4c82-b8f3-ab9b50d8cc60 tempest-CreateVolumesFromImageTest-429736176 None] Created volume successfully.
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Flow 'volume_create_manager' (fd3139a5-29c7-4fae-8ffe-be2be2f320c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6065e060-47d2-4e70-9cb5-80ae7af156b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6065e060-47d2-4e70-9cb5-80ae7af156b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1103172014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d01dbda-9cb3-4a1c-9b53-3e3305a54581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797c046d23d14763a8b119f98eb7d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:10Z,use_quota=True,user_id='61c08a85166f4394811867dcb8986a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cde548-374a-45bc-9c24-d27f40c1f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cde548-374a-45bc-9c24-d27f40c1f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64a5cf3-479b-41b9-a88f-dba6cce77529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64a5cf3-479b-41b9-a88f-dba6cce77529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d01dbda-9cb3-4a1c-9b53-3e3305a54581', 'volume_name': 'volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cc9b4c-6723-4b46-87de-bc1b498afb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cc9b4c-6723-4b46-87de-bc1b498afb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5892904f-8733-4ac4-95fe-c549a5e0f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Volume 0d01dbda-9cb3-4a1c-9b53-3e3305a54581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581', 'volume_size': 1}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-01cc29a3-0ab4-4cb4-b71d-74ca5821e73c tempest-GroupsTest-1895069065 None] Group tempest-Group2-771759809: creating
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-01cc29a3-0ab4-4cb4-b71d-74ca5821e73c tempest-GroupsTest-1895069065 None] Group tempest-Group2-771759809: created successfully
Apr 15 14:39:09 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-01cc29a3-0ab4-4cb4-b71d-74ca5821e73c tempest-GroupsTest-1895069065 None] Create group completed successfully.
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669 1073741824" returned: 0 in 0.668s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:09 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669
Apr 15 14:39:09 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Flow 'volume_create_manager' (bea571f7-f61f-4011-8b8e-7d4d67de342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:10 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b160d33b-85b1-44fd-b17a-8fd92e37085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669" returned: 0 in 0.515s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1103172014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d01dbda-9cb3-4a1c-9b53-3e3305a54581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797c046d23d14763a8b119f98eb7d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:10Z,use_quota=True,user_id='61c08a85166f4394811867dcb8986a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Creating volume 0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:10 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b160d33b-85b1-44fd-b17a-8fd92e37085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1360132542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf0dc213f5410a977da5b65c78ce05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:10Z,use_quota=True,user_id='3d43e9bef42b4fc589d7ba3cb581b0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dc1b1c-7f58-4c4a-bea3-80ff94e58433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:10 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 1073741824
Apr 15 14:39:10 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dc1b1c-7f58-4c4a-bea3-80ff94e58433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bd0cf8-416c-4b8d-89d0-f0cce77d35c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bd0cf8-416c-4b8d-89d0-f0cce77d35c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e', 'volume_name': 'volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1467ed-ef0c-4216-8c92-1f78c449f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1467ed-ef0c-4216-8c92-1f78c449f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a10ede-ae14-4708-8ad8-07df6b989a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:10 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Volume a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e', 'volume_size': 1}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98dd546-2088-480e-81b3-dca4c2aebee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bca19e-021d-4422-9612-43b333674669', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75fcfec-7824-443f-b635-c108c21128c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:10 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Volume volume-75bca19e-021d-4422-9612-43b333674669 (75bca19e-021d-4422-9612-43b333674669): created successfully
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75fcfec-7824-443f-b635-c108c21128c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Flow 'volume_create_manager' (d32fa474-a550-4ebf-83af-4a73914d5ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1ce09746-47d2-4665-ac17-0e00fdc5c3a5 tempest-CreateVolumesFromImageTest-429736176 None] Created volume successfully.
Apr 15 14:39:10 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 1073741824" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:10 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581
Apr 15 14:39:10 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Flow 'volume_create_manager' (52ec7f80-ccba-427f-a7c9-7cc10cf620d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41103e7-9bdf-4058-8498-e22fa1975830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41103e7-9bdf-4058-8498-e22fa1975830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900185776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7583dfd6-b545-4b9e-b51e-73c79724daf9,host='devstack@QuobyteHD#QuobyteHD',id=2b8ccf66-dde5-4366-949c-b92a4df3de87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aee529ae6d94d0b86b1ee18286b9643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:11Z,use_quota=True,user_id='d65a737298b74b0e9a1b645aa42015ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03cd9985-5576-4bd1-8cfc-da967adf19a7),volume_type_id=03cd9985-5576-4bd1-8cfc-da967adf19a7)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48156ac-7f57-4ee3-86f9-6ce945fea839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48156ac-7f57-4ee3-86f9-6ce945fea839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7900a60f-950e-4704-b512-034b5737ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7900a60f-950e-4704-b512-034b5737ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8ccf66-dde5-4366-949c-b92a4df3de87', 'volume_name': 'volume-2b8ccf66-dde5-4366-949c-b92a4df3de87', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79560dc7-7a4c-49d8-b261-c4a547dee62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79560dc7-7a4c-49d8-b261-c4a547dee62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07690f07-2634-46c5-aeb8-fa0878e63b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Volume 2b8ccf66-dde5-4366-949c-b92a4df3de87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8ccf66-dde5-4366-949c-b92a4df3de87', 'volume_size': 1}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:11 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" returned: 0 in 0.473s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1360132542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf0dc213f5410a977da5b65c78ce05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:10Z,use_quota=True,user_id='3d43e9bef42b4fc589d7ba3cb581b0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Creating volume a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:11 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5892904f-8733-4ac4-95fe-c549a5e0f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6866aae7-a70c-4906-ad1c-df6b6b77aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:11 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e 1073741824
Apr 15 14:39:11 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Volume volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 (0d01dbda-9cb3-4a1c-9b53-3e3305a54581): created successfully
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6866aae7-a70c-4906-ad1c-df6b6b77aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Flow 'volume_create_manager' (fd3139a5-29c7-4fae-8ffe-be2be2f320c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6cbd80d0-2163-4320-a5ee-f1d963e0dfe6 tempest-SnapshotMetadataTestJSON-338420243 None] Created volume successfully.
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-75bca19e-021d-4422-9612-43b333674669-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-75bca19e-021d-4422-9612-43b333674669-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-quobyte-75bca19e-021d-4422-9612-43b333674669" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-75bca19e-021d-4422-9612-43b333674669" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b911293e-cdd9-4221-9d88-b4826e629d39]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:11 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669
Apr 15 14:39:11 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:12 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e 1073741824" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:12 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e
Apr 15 14:39:12 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:12 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:12 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669
Apr 15 14:39:12 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:12 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7583dfd6-b545-4b9e-b51e-73c79724daf9,created_at=2026-04-15T12:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900185776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7583dfd6-b545-4b9e-b51e-73c79724daf9,host='devstack@QuobyteHD#QuobyteHD',id=2b8ccf66-dde5-4366-949c-b92a4df3de87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aee529ae6d94d0b86b1ee18286b9643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:11Z,use_quota=True,user_id='d65a737298b74b0e9a1b645aa42015ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03cd9985-5576-4bd1-8cfc-da967adf19a7),volume_type_id=03cd9985-5576-4bd1-8cfc-da967adf19a7)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Creating volume 2b8ccf66-dde5-4366-949c-b92a4df3de87 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:12 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a10ede-ae14-4708-8ad8-07df6b989a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403764ed-af80-4ef0-8d3f-9c522d4f08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:12 devstack sudo[88224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 1073741824
Apr 15 14:39:12 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Volume volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e (a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e): created successfully
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403764ed-af80-4ef0-8d3f-9c522d4f08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Flow 'volume_create_manager' (bea571f7-f61f-4011-8b8e-7d4d67de342a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3a2c7ac4-eb43-4990-8894-0dfcddf0d560 tempest-VolumesDeleteCascade-457152414 None] Created volume successfully.
Apr 15 14:39:12 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-75bca19e-021d-4422-9612-43b333674669" returned: 0 in 0.431s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-75bca19e-021d-4422-9612-43b333674669" released by "delete_volume" :: held 0.965s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Created reservations ['657d7aed-2d8e-453e-b7a1-72d7a14634c7', 'd9913b0a-b680-444a-a04c-16f236a87aff', '431ca35f-77e5-4584-9705-0b0dc9643b50', 'd741cd97-8f54-43ba-be7c-bf8b28a5cea4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:12 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:12 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-812205a3-b0af-4c80-a90e-090ba7cbd67d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-812205a3-b0af-4c80-a90e-090ba7cbd67d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-quobyte-812205a3-b0af-4c80-a90e-090ba7cbd67d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-812205a3-b0af-4c80-a90e-090ba7cbd67d" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8abc4b-8878-416e-96ea-a4d944231b5b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:12 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d
Apr 15 14:39:12 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:13 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 1073741824" returned: 0 in 0.529s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:13 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87
Apr 15 14:39:13 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:13 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.450s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Deleted volume successfully.
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f79bb7-7658-4b21-9e60-79a7e00222e6 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-75bca19e-021d-4422-9612-43b333674669-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:13 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:13 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d
Apr 15 14:39:13 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:13 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.725s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Creating offline snapshot efd588b4-8478-47f0-8ee0-3240858d1a3a of volume 0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07690f07-2634-46c5-aeb8-fa0878e63b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8ccf66-dde5-4366-949c-b92a4df3de87', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2994b7af-2cfe-498d-a750-f76a71eb4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Volume volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 (2b8ccf66-dde5-4366-949c-b92a4df3de87): created successfully
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2994b7af-2cfe-498d-a750-f76a71eb4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Flow 'volume_create_manager' (52ec7f80-ccba-427f-a7c9-7cc10cf620d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa5e41d-3b8e-4883-993c-d0f8dbb4c5f8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0c7b87d4-39b9-43bc-b905-86452ab425ca tempest-GroupsTest-1895069065 None] Created volume successfully.
Apr 15 14:39:13 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581
Apr 15 14:39:13 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:13 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-812205a3-b0af-4c80-a90e-090ba7cbd67d" returned: 0 in 0.474s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-812205a3-b0af-4c80-a90e-090ba7cbd67d" released by "delete_volume" :: held 1.016s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Created reservations ['0089d53e-828c-4857-846e-13970b6f8ac9', '98430951-bc6a-4f6c-9601-25c11142adee', 'd3caf7a2-d2cf-4edc-b900-236e36757824', 'ec11e0a5-ed1d-4f7d-af74-970f048226de'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:13 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:13 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:14 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:14 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a 1G
Apr 15 14:39:14 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:14 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Deleted volume successfully.
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b9176126-6458-42fa-adf9-f49ec46f4fe0 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-812205a3-b0af-4c80-a90e-090ba7cbd67d-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:14 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a 1G" returned: 0 in 0.538s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:14 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a
Apr 15 14:39:14 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Acquiring lock "cinder-quobyte-2b8ccf66-dde5-4366-949c-b92a4df3de87" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Lock "cinder-quobyte-2b8ccf66-dde5-4366-949c-b92a4df3de87" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedd7b08-e63a-4286-a622-db9760741efd]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-30b719b9-5df0-4403-8c1b-012c3e5bae45-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-30b719b9-5df0-4403-8c1b-012c3e5bae45-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:14 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87
Apr 15 14:39:14 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-quobyte-30b719b9-5df0-4403-8c1b-012c3e5bae45" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-30b719b9-5df0-4403-8c1b-012c3e5bae45" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c08a11b-e79a-4e2d-a1f4-0e03b9cb57d7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:15 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45
Apr 15 14:39:15 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:15 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a" returned: 0 in 0.529s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:15 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a is being set with open permissions: ugo+rw
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:15 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a
Apr 15 14:39:15 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:15 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:15 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87
Apr 15 14:39:15 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:15 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45" returned: 0 in 0.483s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:15 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45
Apr 15 14:39:15 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:15 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:15 devstack sudo[88278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info
Apr 15 14:39:15 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:15 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b8ccf66-dde5-4366-949c-b92a4df3de87" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Lock "cinder-quobyte-2b8ccf66-dde5-4366-949c-b92a4df3de87" released by "delete_volume" :: held 0.989s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Created reservations ['40061e07-aeb0-4e64-b9ab-514fbfe5ebab'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:15 devstack cinder-volume[83037]: WARNING cinder.quota [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-245897361 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-245897361, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:39:15 devstack cinder-volume[83037]: WARNING cinder.quota [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-245897361 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-245897361, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Created reservations ['e7e5a36e-8c0c-4900-bd13-69a3cc6ecbc3', 'bc5121a1-9d67-4010-823f-b627f4f3f60c', '9bd9fa15-94e3-414d-946a-9a0d57050e37', '7ec43ae1-619d-4e38-9586-4af1a0af656f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:15 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30b719b9-5df0-4403-8c1b-012c3e5bae45" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-30b719b9-5df0-4403-8c1b-012c3e5bae45" released by "delete_volume" :: held 0.964s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Created reservations ['4abb8158-7ae2-402d-97e4-12a28c140902', '13db14fe-677f-4fe3-ab79-3647c198f049', 'b359ef9d-f396-4825-b05d-90fe7524a9f8', '8e9604fa-c221-43f1-80b6-381acdf331a3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:16 devstack sudo[88283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:16 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:16 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info" returned: 0 in 0.480s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:16 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info is being set with open permissions: ugo+rw
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:16 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:16 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:16 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info
Apr 15 14:39:16 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:16 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.393s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Deleted volume successfully.
Apr 15 14:39:16 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c0b59f1e-936c-4fff-80cd-8db1561234d2 tempest-GroupsTest-1895069065 None] Delete group completed successfully.
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-63ea3803-c1ec-464f-89f3-466424527d33 tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-30b719b9-5df0-4403-8c1b-012c3e5bae45-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:16 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.info" returned: 0 in 0.417s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.755s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Creating offline snapshot 98eb5288-617c-4f59-bd97-dbfe2688e652 of volume a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:39:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9dbaf33d-980f-4d7d-ad82-e2020db6a084 tempest-SnapshotMetadataTestJSON-338420243 None] Create snapshot completed successfully
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374f129-23e3-4e73-83af-3b8cc877a845]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:16 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e
Apr 15 14:39:16 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:16 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:17 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 1G
Apr 15 14:39:17 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Created reservations ['9e617424-550c-4d5d-b52f-325c5cefc5c9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:17 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:17 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-quobyte-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2973af04-fe4b-4aca-a64c-81b5d8dbcdf2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:17 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d
Apr 15 14:39:17 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:17 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 1G" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:17 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:17 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "cinder-efd588b4-8478-47f0-8ee0-3240858d1a3a-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-efd588b4-8478-47f0-8ee0-3240858d1a3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "cinder-quobyte-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-quobyte-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "cinder-quobyte-efd588b4-8478-47f0-8ee0-3240858d1a3a" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-quobyte-efd588b4-8478-47f0-8ee0-3240858d1a3a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Deleting offline snapshot efd588b4-8478-47f0-8ee0-3240858d1a3a of volume 0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] snapshot_file for this snap is: volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ca0b8-c95b-4a63-8f1b-9e1845731315]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:17 devstack sudo[88308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a
Apr 15 14:39:17 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:17 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.630s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-795b0549-2cf4-484a-b613-49b8849291b2 tempest-GroupsTest-1895069065 None] Delete group completed successfully.
Apr 15 14:39:17 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:17 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d
Apr 15 14:39:17 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:18 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.511s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:18 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 is being set with open permissions: ugo+rw
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:18 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:18 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:18 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:18 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d" returned: 0 in 0.445s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a" returned: 0 in 0.575s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d" released by "delete_volume" :: held 1.037s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1010ed05-7b8d-4628-9f38-7ed401fd99c8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Created reservations ['665cf16d-c586-4537-86ca-997f42dd283c', '02edd07e-c255-4310-ba1b-17e59ceddd26', '6fd07b0b-5b50-48f0-bd6f-468e0366679e', '7faa6603-e586-4044-b037-510fdc28f256'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:18 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581
Apr 15 14:39:18 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:18 devstack sudo[88328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:18 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:18 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-506e4e20-98ac-416f-993a-394e55af0a2d tempest-GroupsTest-1895069065 None] Group tempest-GroupsTest-Group-681503635: creating
Apr 15 14:39:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-506e4e20-98ac-416f-993a-394e55af0a2d tempest-GroupsTest-1895069065 None] Group tempest-GroupsTest-Group-681503635: created successfully
Apr 15 14:39:18 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info
Apr 15 14:39:18 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-506e4e20-98ac-416f-993a-394e55af0a2d tempest-GroupsTest-1895069065 None] Create group completed successfully.
Apr 15 14:39:18 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" returned: 0 in 0.515s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:18 devstack sudo[88337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a
Apr 15 14:39:18 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:18 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Deleted volume successfully.
Apr 15 14:39:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d434c796-0255-4da8-852d-11c70b7d7b9b tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-280ca9ce-b81f-4c3a-8d6b-570ab28ef78d-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:19 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info" returned: 0 in 0.443s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:19 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info is being set with open permissions: ugo+rw
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:19 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info
Apr 15 14:39:19 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:19 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a" returned: 0 in 0.474s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:19 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a
Apr 15 14:39:19 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-2b26ba2b-a53c-45f5-b09b-fd874737b88d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-2b26ba2b-a53c-45f5-b09b-fd874737b88d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "cinder-quobyte-2b26ba2b-a53c-45f5-b09b-fd874737b88d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-2b26ba2b-a53c-45f5-b09b-fd874737b88d" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[49170b4e-993a-442b-8c42-24fd8ab8f22c]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:19 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.info" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7a2861e0-b863-42e2-8271-5dc78d9446ea tempest-VolumesDeleteCascade-457152414 None] Create snapshot completed successfully
Apr 15 14:39:19 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d
Apr 15 14:39:19 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:19 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581.efd588b4-8478-47f0-8ee0-3240858d1a3a" returned: 0 in 0.439s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-quobyte-efd588b4-8478-47f0-8ee0-3240858d1a3a" released by "_delete_snapshot" :: held 2.070s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-quobyte-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" released by "delete_snapshot" :: held 2.088s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Created reservations ['40e3d1c7-ac6e-4b98-b221-871b4d601626', '04f645e5-ab88-4696-a4cd-f517f7953848', '4d0c58d4-4bc5-45b4-8cce-c78626e7ab84', '6b63878a-9976-4d4c-8d32-e5af6a9be9a6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Delete snapshot completed successfully.
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d9d32963-0a40-4d1b-b32a-aa5997056178 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-efd588b4-8478-47f0-8ee0-3240858d1a3a-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:19 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Flow 'volume_create_manager' (5da1a2e5-1503-44e9-a261-44f1acc1be12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f65c2e-78bd-4bad-ab0f-e238e25dc2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:20 devstack sudo[88354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d
Apr 15 14:39:20 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f65c2e-78bd-4bad-ab0f-e238e25dc2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112248550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a2d26e8-c9a8-429d-8fd1-9d0921595059,host='devstack@QuobyteHD#QuobyteHD',id=1b19681f-9d88-4759-a4b8-113388d6c20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aee529ae6d94d0b86b1ee18286b9643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:20Z,use_quota=True,user_id='d65a737298b74b0e9a1b645aa42015ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf09488-d9c5-4068-8564-f7044a150842),volume_type_id=1cf09488-d9c5-4068-8564-f7044a150842)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39813e62-0a5b-473b-9916-34218c00ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39813e62-0a5b-473b-9916-34218c00ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8b33c3-55f6-40d3-b9b5-e773834add7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8b33c3-55f6-40d3-b9b5-e773834add7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b19681f-9d88-4759-a4b8-113388d6c20b', 'volume_name': 'volume-1b19681f-9d88-4759-a4b8-113388d6c20b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99e08d-754a-4233-8907-dfbe17ff78fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99e08d-754a-4233-8907-dfbe17ff78fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c80ac0-8f26-4e3b-85ca-d8b5b9f7d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Volume 1b19681f-9d88-4759-a4b8-113388d6c20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b19681f-9d88-4759-a4b8-113388d6c20b', 'volume_size': 1}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0a2d26e8-c9a8-429d-8fd1-9d0921595059,created_at=2026-04-15T12:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112248550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a2d26e8-c9a8-429d-8fd1-9d0921595059,host='devstack@QuobyteHD#QuobyteHD',id=1b19681f-9d88-4759-a4b8-113388d6c20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aee529ae6d94d0b86b1ee18286b9643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:20Z,use_quota=True,user_id='d65a737298b74b0e9a1b645aa42015ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf09488-d9c5-4068-8564-f7044a150842),volume_type_id=1cf09488-d9c5-4068-8564-f7044a150842)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Creating volume 1b19681f-9d88-4759-a4b8-113388d6c20b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:20 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:20 devstack sudo[88356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b 1073741824
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:20 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:20 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2b26ba2b-a53c-45f5-b09b-fd874737b88d" returned: 0 in 0.410s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-quobyte-2b26ba2b-a53c-45f5-b09b-fd874737b88d" released by "delete_volume" :: held 0.993s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Created reservations ['d6d0f7c3-3584-495d-8b3c-38cfdf925ae6', '1d0f450c-2a34-4ed1-ae60-1445cc8ec80f', '966a5bf3-d105-453e-be4e-3911c72d4284', 'eb947dbb-d409-4cff-bdff-f4d544815279'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:20 devstack sudo[88362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:20 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:20 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b 1073741824" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:20 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b
Apr 15 14:39:20 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "cinder-0d01dbda-9cb3-4a1c-9b53-3e3305a54581-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-0d01dbda-9cb3-4a1c-9b53-3e3305a54581-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "cinder-quobyte-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-quobyte-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a052ff-00dd-4710-8881-b6bdbd7d2dd0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:20 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581
Apr 15 14:39:20 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:20 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Deleted volume successfully.
Apr 15 14:39:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a36beefa-60f1-4556-a3c2-3dca4a2aa3bc tempest-CreateVolumesFromImageTest-429736176 None] Lock "cinder-2b26ba2b-a53c-45f5-b09b-fd874737b88d-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:21 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.028s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c80ac0-8f26-4e3b-85ca-d8b5b9f7d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b19681f-9d88-4759-a4b8-113388d6c20b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be3fe8e-58d5-4f20-a44d-ba68bb484026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Creating offline snapshot 6d13f1ef-cd3a-44b2-b1c3-18e19397dcea of volume a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:39:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Volume volume-1b19681f-9d88-4759-a4b8-113388d6c20b (1b19681f-9d88-4759-a4b8-113388d6c20b): created successfully
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be3fe8e-58d5-4f20-a44d-ba68bb484026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Flow 'volume_create_manager' (5da1a2e5-1503-44e9-a261-44f1acc1be12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e446c-ee91-46db-a397-0bc1497714bf]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f99a0a29-016c-4b00-b516-eaa46480a831 tempest-GroupsTest-1895069065 None] Created volume successfully.
Apr 15 14:39:21 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:21 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:21 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:21 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581
Apr 15 14:39:21 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:21 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.499s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:21 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea 1G
Apr 15 14:39:21 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:21 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-quobyte-0d01dbda-9cb3-4a1c-9b53-3e3305a54581" released by "delete_volume" :: held 1.053s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Created reservations ['be8ab8e8-8bf3-4e5c-a696-8bbb104bab15', '8da463c7-4587-431a-bfbc-021f299811f0', '7f0f00d2-adeb-4372-bd93-79025f0fcb8a', 'f3bf2d30-d4a3-4057-ae07-b036c9f7dca4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:22 devstack sudo[88383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:22 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:22 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea 1G" returned: 0 in 0.605s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:22 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea
Apr 15 14:39:22 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Flow 'volume_create_manager' (80eaf8c7-649d-4cf2-acc9-ae7628abf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bd6184-ff12-4fce-9f46-e1b6c0ee8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bd6184-ff12-4fce-9f46-e1b6c0ee8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-846856018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a2d26e8-c9a8-429d-8fd1-9d0921595059,host='devstack@QuobyteHD#QuobyteHD',id=8fb88fcf-1d3f-453b-b71e-a93fb2999adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aee529ae6d94d0b86b1ee18286b9643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:22Z,use_quota=True,user_id='d65a737298b74b0e9a1b645aa42015ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf09488-d9c5-4068-8564-f7044a150842),volume_type_id=1cf09488-d9c5-4068-8564-f7044a150842)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceaad0b-6c3a-4cf3-a718-99abdd7a159d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceaad0b-6c3a-4cf3-a718-99abdd7a159d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b5b56d-1647-4881-b2bf-17de5dda97d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b5b56d-1647-4881-b2bf-17de5dda97d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb88fcf-1d3f-453b-b71e-a93fb2999adf', 'volume_name': 'volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f6cb8-75b9-4943-904b-39d71dedbc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f6cb8-75b9-4943-904b-39d71dedbc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c4f383-f7a5-4245-bd8c-ef3cfd72f725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Volume 8fb88fcf-1d3f-453b-b71e-a93fb2999adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf', 'volume_size': 1}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:22 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Deleted volume successfully.
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3d47777d-8ba6-464f-900d-4f2b0279e919 tempest-SnapshotMetadataTestJSON-338420243 None] Lock "cinder-0d01dbda-9cb3-4a1c-9b53-3e3305a54581-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:22 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:22 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea is being set with open permissions: ugo+rw
Apr 15 14:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:22 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea
Apr 15 14:39:22 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:23 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" returned: 0 in 0.449s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0a2d26e8-c9a8-429d-8fd1-9d0921595059,created_at=2026-04-15T12:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-846856018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a2d26e8-c9a8-429d-8fd1-9d0921595059,host='devstack@QuobyteHD#QuobyteHD',id=8fb88fcf-1d3f-453b-b71e-a93fb2999adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aee529ae6d94d0b86b1ee18286b9643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:22Z,use_quota=True,user_id='d65a737298b74b0e9a1b645aa42015ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf09488-d9c5-4068-8564-f7044a150842),volume_type_id=1cf09488-d9c5-4068-8564-f7044a150842)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Creating volume 8fb88fcf-1d3f-453b-b71e-a93fb2999adf {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:23 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4e00c9fa-c2db-43e6-885d-f7a417bf06fc tempest-VolumesDeleteCascade-457152414 None] Create snapshot completed successfully
Apr 15 14:39:23 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf 1073741824
Apr 15 14:39:23 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (a185701a-8876-496e-b856-3ac7bfa9db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3d4d31-9384-4aa7-99ec-14f009b0e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3d4d31-9384-4aa7-99ec-14f009b0e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414459393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f0247f-ed63-4424-9efd-1b9eb1cdd088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:24Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df31c7f0-d846-4afb-ada6-cbd8836fa56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df31c7f0-d846-4afb-ada6-cbd8836fa56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b44208b-c4c4-4d2a-887d-f463cb08b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b44208b-c4c4-4d2a-887d-f463cb08b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f0247f-ed63-4424-9efd-1b9eb1cdd088', 'volume_name': 'volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af06797-adab-4da3-b1f9-3fb8d73b473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af06797-adab-4da3-b1f9-3fb8d73b473e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43ce8ed-6ede-471b-8b53-28a3a67e057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume f8f0247f-ed63-4424-9efd-1b9eb1cdd088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088', 'volume_size': 1}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:23 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf 1073741824" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:23 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf
Apr 15 14:39:23 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Performing cascade delete. {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 14:39:24 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-6d13f1ef-cd3a-44b2-b1c3-18e19397dcea-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414459393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f0247f-ed63-4424-9efd-1b9eb1cdd088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:24Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Creating volume f8f0247f-ed63-4424-9efd-1b9eb1cdd088 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:24 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c4f383-f7a5-4245-bd8c-ef3cfd72f725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3eca9a-cb1b-4922-bf9e-0bbe38663e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:24 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 1073741824
Apr 15 14:39:24 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-6d13f1ef-cd3a-44b2-b1c3-18e19397dcea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:24 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Volume volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf (8fb88fcf-1d3f-453b-b71e-a93fb2999adf): created successfully
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3eca9a-cb1b-4922-bf9e-0bbe38663e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Flow 'volume_create_manager' (80eaf8c7-649d-4cf2-acc9-ae7628abf304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4e899e5e-73cc-4b68-a3bc-00100c665d38 tempest-GroupsTest-1895069065 None] Created volume successfully.
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Deleting offline snapshot 6d13f1ef-cd3a-44b2-b1c3-18e19397dcea of volume a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] snapshot_file for this snap is: volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9142ffe-2ca3-4240-8aa4-d23b1d2ac7ce]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:24 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea
Apr 15 14:39:24 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-878c62bb-ce95-4591-abdf-ff341b7ce8b3 tempest-GroupsTest-1895069065 None] Update group completed successfully.
Apr 15 14:39:24 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 1073741824" returned: 0 in 0.623s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:24 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:24 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088
Apr 15 14:39:24 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd30551-0fcc-49fc-aa92-12bebc88f050]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:25 devstack sudo[88419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:25 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Flow 'volume_create_manager' (424e5284-6684-4da1-bf1c-cbb3c194a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556702dd-acae-4a70-97d6-6af71a5cd0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556702dd-acae-4a70-97d6-6af71a5cd0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-86909185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b9da35-e2ea-4d68-ab3d-6cc9a36697de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf171dd58246c3aec2a83329f95e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:25Z,use_quota=True,user_id='a41dc96dec72476397536cf50997b64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4326095a-47f4-4a93-9533-0aabe5c40830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4326095a-47f4-4a93-9533-0aabe5c40830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d355596-1e39-4f59-8ea9-2c7e56c2b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d355596-1e39-4f59-8ea9-2c7e56c2b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b9da35-e2ea-4d68-ab3d-6cc9a36697de', 'volume_name': 'volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1abd8c-b96c-4c93-97da-294bb2e7d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1abd8c-b96c-4c93-97da-294bb2e7d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a0d2f0-6b53-4e70-8e0a-58a5af545c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Volume 85b9da35-e2ea-4d68-ab3d-6cc9a36697de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de', 'volume_size': 1}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:25 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-86909185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b9da35-e2ea-4d68-ab3d-6cc9a36697de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf171dd58246c3aec2a83329f95e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:25Z,use_quota=True,user_id='a41dc96dec72476397536cf50997b64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Creating volume 85b9da35-e2ea-4d68-ab3d-6cc9a36697de {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:25 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43ce8ed-6ede-471b-8b53-28a3a67e057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0f3b9b-6555-45b1-ad3b-18d4cd28b8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:25 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de 1073741824
Apr 15 14:39:25 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 (f8f0247f-ed63-4424-9efd-1b9eb1cdd088): created successfully
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0f3b9b-6555-45b1-ad3b-18d4cd28b8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (a185701a-8876-496e-b856-3ac7bfa9db33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8c1e0da1-0d67-409d-860f-938c9fc10c8e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created volume successfully.
Apr 15 14:39:25 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.499s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:25 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea
Apr 15 14:39:25 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-98aba142-49c7-43ae-9a55-2878637a807a tempest-GroupsTest-1895069065 None] Update group completed successfully.
Apr 15 14:39:25 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (e932dee7-5430-4a22-95a0-e6d598f778a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0e1ad0-088d-42f5-b64a-dd7a1564df96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0e1ad0-088d-42f5-b64a-dd7a1564df96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941198225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b9ad0e-6a7a-4548-964a-ca95fa45ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:26Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fd832d-cf6e-4d5e-8030-ad2d870f58d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fd832d-cf6e-4d5e-8030-ad2d870f58d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d3183d-34c0-4847-81df-39a0d1e93e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d3183d-34c0-4847-81df-39a0d1e93e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b9ad0e-6a7a-4548-964a-ca95fa45ee57', 'volume_name': 'volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0ef553-fe4b-4cb3-9a7a-7bc19952f5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0ef553-fe4b-4cb3-9a7a-7bc19952f5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a736711a-bfff-4229-9e1c-2cea7846576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume 66b9ad0e-6a7a-4548-964a-ca95fa45ee57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57', 'volume_size': 1}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de 1073741824" returned: 0 in 0.637s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:26 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:26 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea
Apr 15 14:39:26 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:26 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de
Apr 15 14:39:26 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (a77e91bb-b5e3-4e10-a346-22ebe375f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03106010-fec1-459f-9d13-d5ffbdb8f5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03106010-fec1-459f-9d13-d5ffbdb8f5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272429208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af25b39c-29bc-412a-b4ae-ede24910e76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:26Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de3f7a7-22e2-4588-be88-eecfc685f270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de3f7a7-22e2-4588-be88-eecfc685f270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c76270-fb36-4e2a-aa81-5769d02b8929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c76270-fb36-4e2a-aa81-5769d02b8929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af25b39c-29bc-412a-b4ae-ede24910e76c', 'volume_name': 'volume-af25b39c-29bc-412a-b4ae-ede24910e76c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3407cd28-e1d5-47e2-a006-3d7b1dfc9ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3407cd28-e1d5-47e2-a006-3d7b1dfc9ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b872ffb3-7fec-4003-be4e-a8abbbde0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume af25b39c-29bc-412a-b4ae-ede24910e76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af25b39c-29bc-412a-b4ae-ede24910e76c', 'volume_size': 1}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (30351f20-c789-4173-9bba-164b3b1cc2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ddcac1-f29e-495f-97e7-b12ee7f08d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ddcac1-f29e-495f-97e7-b12ee7f08d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774637023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d0d552-5b66-4922-8327-cd22220284b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:26Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e71b09-f620-423e-ab1f-a70a17187450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e71b09-f620-423e-ab1f-a70a17187450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18672566-53ca-463f-8edb-0487d6fca21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18672566-53ca-463f-8edb-0487d6fca21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d0d552-5b66-4922-8327-cd22220284b2', 'volume_name': 'volume-46d0d552-5b66-4922-8327-cd22220284b2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b341bc43-8c89-4a01-8eba-29c49d99eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b341bc43-8c89-4a01-8eba-29c49d99eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8e1199-2832-4322-991b-af6ee987d6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume 46d0d552-5b66-4922-8327-cd22220284b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d0d552-5b66-4922-8327-cd22220284b2', 'volume_size': 1}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:26 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-6d13f1ef-cd3a-44b2-b1c3-18e19397dcea" released by "_delete_snapshot" :: held 2.194s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" released by "delete_snapshot" :: held 2.213s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (46724466-f8c8-4f54-9549-50b4e9c919f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023523a1-b66f-4a26-9da8-f12740b2929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023523a1-b66f-4a26-9da8-f12740b2929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174406243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fa83cf-71a3-4c97-a99c-d4229338f4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:27Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55764a2-3f45-41cf-8c9a-9370b97383b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55764a2-3f45-41cf-8c9a-9370b97383b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0387077-a489-4d8e-8040-e496118f6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0387077-a489-4d8e-8040-e496118f6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fa83cf-71a3-4c97-a99c-d4229338f4b2', 'volume_name': 'volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7873026c-5a00-42f9-aca5-bcefd1675b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7873026c-5a00-42f9-aca5-bcefd1675b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4b1208-9079-42c2-a2ce-21f5c6bffcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume 89fa83cf-71a3-4c97-a99c-d4229338f4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2', 'volume_size': 1}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de" returned: 0 in 0.623s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941198225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b9ad0e-6a7a-4548-964a-ca95fa45ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:26Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Creating volume 66b9ad0e-6a7a-4548-964a-ca95fa45ee57 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a0d2f0-6b53-4e70-8e0a-58a5af545c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038a529b-4a65-4045-ac15-457e70455565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 1073741824
Apr 15 14:39:26 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Volume volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de (85b9da35-e2ea-4d68-ab3d-6cc9a36697de): created successfully
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038a529b-4a65-4045-ac15-457e70455565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Flow 'volume_create_manager' (424e5284-6684-4da1-bf1c-cbb3c194a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Created reservations ['993523ea-696c-4982-88e2-80f9550ef147', 'b4a4c582-949f-40ef-b01b-1b6c88a99b1c', 'b2792db1-a06d-49c6-bb0c-520dd01ff821', 'fe7e7a03-7868-4a3a-affc-904243f40993'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-90a14ced-831f-4c6a-97b5-c486d7661fc6 tempest-AbsoluteLimitsTests-1248012349 None] Created volume successfully.
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (754caf81-d4c9-41b6-a0f0-10ee92674aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20127d3-f39a-4742-ad31-1977913c5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20127d3-f39a-4742-ad31-1977913c5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567402549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e962d877-02b2-4c68-aa66-0963173b853e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:27Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89991998-58a9-4e8b-8d85-3d333b62630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89991998-58a9-4e8b-8d85-3d333b62630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00df7f1d-dfd3-4cdd-9447-02eb21ea6dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00df7f1d-dfd3-4cdd-9447-02eb21ea6dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e962d877-02b2-4c68-aa66-0963173b853e', 'volume_name': 'volume-e962d877-02b2-4c68-aa66-0963173b853e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767d2c43-e5ab-4fb2-8e70-e1cfc8796c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767d2c43-e5ab-4fb2-8e70-e1cfc8796c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0109a775-e23a-4faa-86ca-de61ef132064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume e962d877-02b2-4c68-aa66-0963173b853e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e962d877-02b2-4c68-aa66-0963173b853e', 'volume_size': 1}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Delete snapshot completed successfully.
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-6d13f1ef-cd3a-44b2-b1c3-18e19397dcea-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-98eb5288-617c-4f59-bd97-dbfe2688e652-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-98eb5288-617c-4f59-bd97-dbfe2688e652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-98eb5288-617c-4f59-bd97-dbfe2688e652" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-98eb5288-617c-4f59-bd97-dbfe2688e652" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Deleting offline snapshot 98eb5288-617c-4f59-bd97-dbfe2688e652 of volume a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] snapshot_file for this snap is: volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6966a8-728a-420e-80e1-7f97cecf6732]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:27 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:27 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:27 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 1073741824" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Acquiring lock "cinder-quobyte-1b19681f-9d88-4759-a4b8-113388d6c20b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Lock "cinder-quobyte-1b19681f-9d88-4759-a4b8-113388d6c20b" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b821b2-44d0-43ea-b611-426a75186f57]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:27 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57
Apr 15 14:39:27 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:27 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b
Apr 15 14:39:27 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Acquiring lock "cinder-85b9da35-e2ea-4d68-ab3d-6cc9a36697de-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Lock "cinder-85b9da35-e2ea-4d68-ab3d-6cc9a36697de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:27 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Acquiring lock "cinder-quobyte-85b9da35-e2ea-4d68-ab3d-6cc9a36697de" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Lock "cinder-quobyte-85b9da35-e2ea-4d68-ab3d-6cc9a36697de" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa4291-803e-4455-abd2-4d1081f36985]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e3dec3-af57-44e4-b21c-953cfe5805f5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:27 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e
Apr 15 14:39:27 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:27 devstack sudo[88456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de
Apr 15 14:39:27 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:27 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b" returned: 0 in 0.575s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:27 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272429208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af25b39c-29bc-412a-b4ae-ede24910e76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:26Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Creating volume af25b39c-29bc-412a-b4ae-ede24910e76c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:27 devstack sudo[88464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:27 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:27 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c 1073741824
Apr 15 14:39:28 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a736711a-bfff-4229-9e1c-2cea7846576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64282b08-2672-4b25-a8bb-0965ae0f6d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 (66b9ad0e-6a7a-4548-964a-ca95fa45ee57): created successfully
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64282b08-2672-4b25-a8bb-0965ae0f6d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (e932dee7-5430-4a22-95a0-e6d598f778a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-de542a84-1d7a-4e7e-974c-bb2bc4e9dd60 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created volume successfully.
Apr 15 14:39:28 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" returned: 0 in 0.519s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:28 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:28 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de
Apr 15 14:39:28 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:28 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1b19681f-9d88-4759-a4b8-113388d6c20b" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Lock "cinder-quobyte-1b19681f-9d88-4759-a4b8-113388d6c20b" released by "delete_volume" :: held 1.075s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Acquiring lock "cinder-quobyte-8fb88fcf-1d3f-453b-b71e-a93fb2999adf" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Lock "cinder-quobyte-8fb88fcf-1d3f-453b-b71e-a93fb2999adf" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbdf3a3-29b1-415b-9e3b-b8e43ab441e6]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c 1073741824" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:28 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf
Apr 15 14:39:28 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c
Apr 15 14:39:28 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:28 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.535s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-85b9da35-e2ea-4d68-ab3d-6cc9a36697de" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:28 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Lock "cinder-quobyte-85b9da35-e2ea-4d68-ab3d-6cc9a36697de" released by "delete_volume" :: held 1.090s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:28 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Created reservations ['85628bc1-b3e4-417d-9c9e-390dc5ec25b0', '7f32077a-d6d1-4060-a883-3e0cfbb25618', 'c8d87fb7-296c-499d-9126-6122386b793d', 'a3f1a3d9-6cfd-42b7-b316-7a03bb82f6ec'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:28 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:28 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:29 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c" returned: 0 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.580s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774637023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d0d552-5b66-4922-8327-cd22220284b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:26Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Creating volume 46d0d552-5b66-4922-8327-cd22220284b2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:29 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:29 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b872ffb3-7fec-4003-be4e-a8abbbde0de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af25b39c-29bc-412a-b4ae-ede24910e76c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64aa9dd-c0ab-4d23-918c-800d82825116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf" returned: 0 in 0.626s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:29 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2 1073741824
Apr 15 14:39:29 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:29 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume volume-af25b39c-29bc-412a-b4ae-ede24910e76c (af25b39c-29bc-412a-b4ae-ede24910e76c): created successfully
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64aa9dd-c0ab-4d23-918c-800d82825116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (a77e91bb-b5e3-4e10-a346-22ebe375f04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:29 devstack sudo[88500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf
Apr 15 14:39:29 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d15fdba-2214-4f7f-97d7-d0629a1b7590 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created volume successfully.
Apr 15 14:39:29 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e.98eb5288-617c-4f59-bd97-dbfe2688e652" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-98eb5288-617c-4f59-bd97-dbfe2688e652" released by "_delete_snapshot" :: held 2.246s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" released by "delete_snapshot" :: held 2.259s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:29 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Deleted volume successfully.
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Created reservations ['012c7bdd-12ec-4766-b5cd-60c322183708', '0adf6148-6677-423e-88c2-8c7d6b6b1b80', '2e0ea44c-8a97-42c3-8859-71fecb9e2e87', 'd10cc0ba-e62b-4b18-820e-d1f3fe78b54e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8d1ce2bc-1737-4dd3-bc19-46b3f92c5a9e tempest-AbsoluteLimitsTests-1248012349 None] Lock "cinder-85b9da35-e2ea-4d68-ab3d-6cc9a36697de-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Delete snapshot completed successfully.
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-98eb5288-617c-4f59-bd97-dbfe2688e652-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Snapshots deleted, issuing volume delete {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d17f77b-81bf-42eb-a1c0-d788e82d1704]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:29 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e
Apr 15 14:39:29 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:29 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8fb88fcf-1d3f-453b-b71e-a93fb2999adf" returned: 0 in 0.520s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Lock "cinder-quobyte-8fb88fcf-1d3f-453b-b71e-a93fb2999adf" released by "delete_volume" :: held 1.172s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:29 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2 1073741824" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:29 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2
Apr 15 14:39:29 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Created reservations ['dc8331c9-e523-4477-8098-326537aa588e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:29 devstack cinder-volume[83037]: WARNING cinder.quota [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-736217479 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-736217479, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:39:29 devstack cinder-volume[83037]: WARNING cinder.quota [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-736217479 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-736217479, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Created reservations ['aa0dd2aa-2d91-4bf3-890c-15ffe52a6c4f', '8c669aef-de5e-499e-b241-fd982fad8002', '5f09a8d1-9c26-4ae9-ae95-015952e7f80a', '45611e12-6676-415c-b757-08f6198127c1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Created reservations ['6b2e197b-c943-4e49-b3ed-4af92782dde2', '3553b923-aa5d-4499-84d0-e571545f8dad', '6b13d999-0595-4f48-b46d-95914fd23248', 'a0dae23f-b878-4796-b608-bb1a7500f823'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:29 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" returned: 0 in 0.581s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:29 devstack sudo[88515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:29 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:29 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e
Apr 15 14:39:29 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:30 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.456s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174406243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fa83cf-71a3-4c97-a99c-d4229338f4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:27Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Creating volume 89fa83cf-71a3-4c97-a99c-d4229338f4b2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:30 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8e1199-2832-4322-991b-af6ee987d6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d0d552-5b66-4922-8327-cd22220284b2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3d30d8-b0a3-4fd7-a396-bdfa69d9b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume volume-46d0d552-5b66-4922-8327-cd22220284b2 (46d0d552-5b66-4922-8327-cd22220284b2): created successfully
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3d30d8-b0a3-4fd7-a396-bdfa69d9b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (30351f20-c789-4173-9bba-164b3b1cc2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:30 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 1073741824
Apr 15 14:39:30 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d3b0282-25f0-46a4-885d-9c3293366621 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created volume successfully.
Apr 15 14:39:30 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.476s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9b28099f-522a-4ebb-a3c3-75517f3762ae tempest-GroupsTest-1895069065 None] Delete group completed successfully.
Apr 15 14:39:30 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e" released by "delete_volume" :: held 1.155s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Created reservations ['672ee7ae-1dd3-4418-9399-8706aaa3b524', '2f6e6f83-39fd-4dc9-8585-e694dbe8ae88', 'b36aab5f-fc29-484d-8b15-b174553848fb', '62992a4c-979a-418e-9961-3d645cdeac03'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:30 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:30 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:30 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 1073741824" returned: 0 in 0.711s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:30 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2
Apr 15 14:39:30 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:31 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.716s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Deleted volume successfully.
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Flow 'volume_create_manager' (e0d1af06-06a0-4af9-a2e2-3dcc36f5f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03023c5d-b36c-46f4-a4ef-feaede17e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03023c5d-b36c-46f4-a4ef-feaede17e949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1453503767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c49084-2c31-4826-811a-9793669fff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf0dc213f5410a977da5b65c78ce05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:31Z,use_quota=True,user_id='3d43e9bef42b4fc589d7ba3cb581b0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b156a451-8b1d-42d2-9d57-17f4c0ea601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b156a451-8b1d-42d2-9d57-17f4c0ea601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83fa4674-6bd8-4437-bcad-a470c0697043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83fa4674-6bd8-4437-bcad-a470c0697043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c49084-2c31-4826-811a-9793669fff53', 'volume_name': 'volume-73c49084-2c31-4826-811a-9793669fff53', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c22df36-5a27-41f7-b625-26cad940faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c22df36-5a27-41f7-b625-26cad940faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf6d252-1bfc-49fa-ad5f-27c6595c12a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Volume 73c49084-2c31-4826-811a-9793669fff53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c49084-2c31-4826-811a-9793669fff53', 'volume_size': 1}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a925355a-f7a5-4b07-a0f5-f9c66fc601bf tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-a8ac6541-0c8c-4a21-8e97-fb55ac0f7f8e-delete_volume" released by "delete_volume" :: held 7.096s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:31 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.524s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567402549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e962d877-02b2-4c68-aa66-0963173b853e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6009098fab9f44ccab12250bd4970d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:27Z,use_quota=True,user_id='750fee4f7e9a45baa95a9974bd89ab0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Creating volume e962d877-02b2-4c68-aa66-0963173b853e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:31 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4b1208-9079-42c2-a2ce-21f5c6bffcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:31 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e 1073741824
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649451b8-bc54-47ea-adb5-0c4bcaeb0496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:31 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 (89fa83cf-71a3-4c97-a99c-d4229338f4b2): created successfully
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649451b8-bc54-47ea-adb5-0c4bcaeb0496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (46724466-f8c8-4f54-9549-50b4e9c919f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e98cda92-8e50-4b71-8138-bba983144c58 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created volume successfully.
Apr 15 14:39:31 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e 1073741824" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:32 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e
Apr 15 14:39:32 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:32 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1453503767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c49084-2c31-4826-811a-9793669fff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf0dc213f5410a977da5b65c78ce05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:31Z,use_quota=True,user_id='3d43e9bef42b4fc589d7ba3cb581b0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Creating volume 73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:32 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0109a775-e23a-4faa-86ca-de61ef132064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e962d877-02b2-4c68-aa66-0963173b853e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c7f611-d08f-48d1-b553-f24dfba48f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:32 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 1073741824
Apr 15 14:39:32 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Volume volume-e962d877-02b2-4c68-aa66-0963173b853e (e962d877-02b2-4c68-aa66-0963173b853e): created successfully
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c7f611-d08f-48d1-b553-f24dfba48f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Flow 'volume_create_manager' (754caf81-d4c9-41b6-a0f0-10ee92674aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f0ca846f-d89a-49b6-8212-0b4bd9d319c0 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created volume successfully.
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Flow 'volume_create_manager' (31849ec1-aeb8-4037-a726-90de844525f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e98003b-f652-4009-a1bf-73bf097dc284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e98003b-f652-4009-a1bf-73bf097dc284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1523881777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c2d9d2-5610-4e59-8151-949f87b46c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba87f47694177bbb9cbcc88ecceb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:33Z,use_quota=True,user_id='08ddba44f0b14d2fa9b6ebe919fa3106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56c99f9-5e61-4a00-8f5e-b1caa3a89481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56c99f9-5e61-4a00-8f5e-b1caa3a89481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d94086-dc45-43c5-aea8-1a521744c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d94086-dc45-43c5-aea8-1a521744c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c2d9d2-5610-4e59-8151-949f87b46c54', 'volume_name': 'volume-56c2d9d2-5610-4e59-8151-949f87b46c54', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74405d3-0679-4af0-ae64-772c477e8be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74405d3-0679-4af0-ae64-772c477e8be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77abb7b-822f-4488-ad15-f4eeb8028881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Volume 56c2d9d2-5610-4e59-8151-949f87b46c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c2d9d2-5610-4e59-8151-949f87b46c54', 'volume_size': 2}
Apr 15 14:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:33 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 1073741824" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:33 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:33 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-e962d877-02b2-4c68-aa66-0963173b853e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-e962d877-02b2-4c68-aa66-0963173b853e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:33 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-quobyte-e962d877-02b2-4c68-aa66-0963173b853e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1523881777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c2d9d2-5610-4e59-8151-949f87b46c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4ba87f47694177bbb9cbcc88ecceb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:33Z,use_quota=True,user_id='08ddba44f0b14d2fa9b6ebe919fa3106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Creating volume 56c2d9d2-5610-4e59-8151-949f87b46c54 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:33 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54 2147483648 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf6d252-1bfc-49fa-ad5f-27c6595c12a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c49084-2c31-4826-811a-9793669fff53', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6953ad32-3d3b-428d-9999-2b85f63ca93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:33 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54 2147483648
Apr 15 14:39:33 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-e962d877-02b2-4c68-aa66-0963173b853e" acquired by "delete_volume" :: waited 0.042s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be744c-ca21-4180-ad9a-da73c6e6d859]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Volume volume-73c49084-2c31-4826-811a-9793669fff53 (73c49084-2c31-4826-811a-9793669fff53): created successfully
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6953ad32-3d3b-428d-9999-2b85f63ca93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Flow 'volume_create_manager' (e0d1af06-06a0-4af9-a2e2-3dcc36f5f554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-700cdd13-1e7d-49d9-8c3f-6c3cd6e4d35b tempest-VolumesDeleteCascade-457152414 None] Created volume successfully.
Apr 15 14:39:33 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e
Apr 15 14:39:33 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:34 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:34 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e
Apr 15 14:39:34 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:34 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54 2147483648" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:34 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54
Apr 15 14:39:34 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:34 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e962d877-02b2-4c68-aa66-0963173b853e" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-e962d877-02b2-4c68-aa66-0963173b853e" released by "delete_volume" :: held 1.094s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created reservations ['5197686c-84c5-4769-bc30-7443f6252434', 'b1728378-b51d-4dcd-933d-fae35d21c0d7', 'd775b814-b6bf-432b-9170-27f24bd63c0b', '4ef59624-5f76-4f0b-a1d7-d6685e4b5b60'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:34 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.221s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77abb7b-822f-4488-ad15-f4eeb8028881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c2d9d2-5610-4e59-8151-949f87b46c54', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81e629b-ab11-4367-b828-16ba5e30345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Creating offline snapshot 09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 of volume 73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f774b6-86ed-4c65-965a-7ee8f845afb2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:34 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Volume volume-56c2d9d2-5610-4e59-8151-949f87b46c54 (56c2d9d2-5610-4e59-8151-949f87b46c54): created successfully
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81e629b-ab11-4367-b828-16ba5e30345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Flow 'volume_create_manager' (31849ec1-aeb8-4037-a726-90de844525f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:34 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:34 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-303ea3b6-9f88-47cf-a5f2-a68b9bc30a5f tempest-VolumesCloneNegativeTest-247978922 None] Created volume successfully.
Apr 15 14:39:34 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:34 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Acquiring lock "cinder-56c2d9d2-5610-4e59-8151-949f87b46c54-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Lock "cinder-56c2d9d2-5610-4e59-8151-949f87b46c54-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Acquiring lock "cinder-quobyte-56c2d9d2-5610-4e59-8151-949f87b46c54" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Lock "cinder-quobyte-56c2d9d2-5610-4e59-8151-949f87b46c54" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b3350d-e1be-4416-bfd4-393ef38bd99a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:35 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54
Apr 15 14:39:35 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:35 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Deleted volume successfully.
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d6f16977-155e-4337-88c4-190c1e511554 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-e962d877-02b2-4c68-aa66-0963173b853e-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:35 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.654s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:35 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 1G
Apr 15 14:39:35 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-89fa83cf-71a3-4c97-a99c-d4229338f4b2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-89fa83cf-71a3-4c97-a99c-d4229338f4b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:35 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-quobyte-89fa83cf-71a3-4c97-a99c-d4229338f4b2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54" returned: 0 in 0.574s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-89fa83cf-71a3-4c97-a99c-d4229338f4b2" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[171489fc-3782-4986-9351-a6876bb12c25]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:35 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54
Apr 15 14:39:35 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:35 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2
Apr 15 14:39:35 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:36 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 1G" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c49084-2c31-4826-811a-9793669fff53 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:36 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c49084-2c31-4826-811a-9793669fff53 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3
Apr 15 14:39:36 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:36 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-56c2d9d2-5610-4e59-8151-949f87b46c54" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Lock "cinder-quobyte-56c2d9d2-5610-4e59-8151-949f87b46c54" released by "delete_volume" :: held 1.151s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Created reservations ['d9d02aa5-9b00-4da7-95ca-64866fdf229f', '9b423b8e-c2c1-4b58-a20b-32416b9042d0', 'd5894bbd-d47e-4e15-943c-1c5e06f44658', '9e3960f2-f81d-407e-84b8-485fd6739e02'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:36 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:36 devstack sudo[88593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:36 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:36 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:36 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:36 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c49084-2c31-4826-811a-9793669fff53 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:36 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 is being set with open permissions: ugo+rw
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:36 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3
Apr 15 14:39:36 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:36 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-89fa83cf-71a3-4c97-a99c-d4229338f4b2" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-89fa83cf-71a3-4c97-a99c-d4229338f4b2" released by "delete_volume" :: held 1.174s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:36 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Deleted volume successfully.
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created reservations ['a677d3ea-c54e-43ca-a626-5acf6249973f', 'ef167224-a796-4eb1-a054-3369714dfc2b', '6b99a8ab-8746-46ff-89c1-729d2e5453c9', 'a5a485b3-dc57-4640-8a02-e739217c50a3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a2c9895b-b6a7-447e-95b1-0d3b74abe87b tempest-VolumesCloneNegativeTest-247978922 None] Lock "cinder-56c2d9d2-5610-4e59-8151-949f87b46c54-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:37 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:37 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:37 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:37 devstack sudo[88613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info
Apr 15 14:39:37 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:37 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Deleted volume successfully.
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2643653b-79b6-42d5-a00f-74af2b2d077e tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-89fa83cf-71a3-4c97-a99c-d4229338f4b2-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:37 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info is being set with open permissions: ugo+rw
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:37 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info
Apr 15 14:39:37 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-46d0d552-5b66-4922-8327-cd22220284b2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-46d0d552-5b66-4922-8327-cd22220284b2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-quobyte-46d0d552-5b66-4922-8327-cd22220284b2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-46d0d552-5b66-4922-8327-cd22220284b2" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:38 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa94e9d9-93f7-4de6-9046-655eef5a202e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:38 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.info" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.305s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:38 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2
Apr 15 14:39:38 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-91087017-d90a-4065-96bc-a2083c057fc6 tempest-VolumesDeleteCascade-457152414 None] Create snapshot completed successfully
Apr 15 14:39:38 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2" returned: 0 in 0.562s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:38 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2
Apr 15 14:39:38 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Flow 'volume_create_manager' (cdbdd739-d7de-4fa6-8dd9-9f44e99071af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eacb922-1537-4fb4-9e4e-4dc2180ed155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eacb922-1537-4fb4-9e4e-4dc2180ed155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-814814581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf0dc213f5410a977da5b65c78ce05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09fe1e1d-85e0-461b-a5a3-c7d6956a76d3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:39Z,use_quota=True,user_id='3d43e9bef42b4fc589d7ba3cb581b0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db213e6-d1b2-419b-b56c-2726ec4e4270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db213e6-d1b2-419b-b56c-2726ec4e4270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d548931-f162-48ba-bf15-d8b052b908e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d548931-f162-48ba-bf15-d8b052b908e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d', 'volume_name': 'volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d', 'volume_size': 1, 'snapshot_id': '09fe1e1d-85e0-461b-a5a3-c7d6956a76d3'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d4ef22-fdda-4f9f-adc2-36b4c2cf6f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d4ef22-fdda-4f9f-adc2-36b4c2cf6f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a0a019-26dc-4c44-a434-8d094279ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Volume a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d', 'volume_size': 1, 'snapshot_id': '09fe1e1d-85e0-461b-a5a3-c7d6956a76d3'}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Creating volume a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d from snapshot 09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:39 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-46d0d552-5b66-4922-8327-cd22220284b2" returned: 0 in 0.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-46d0d552-5b66-4922-8327-cd22220284b2" released by "delete_volume" :: held 1.247s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] snapshot: 09fe1e1d-85e0-461b-a5a3-c7d6956a76d3, volume: a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258fa2c-44a1-4949-8af3-ed09e4dab338]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created reservations ['4c50da51-8635-4d8d-a2d1-078a1bfd50b6', '70447983-b6f3-457c-9292-6319ec225b72', '56183786-e615-47de-98e7-bc3d76e1c84b', 'd380206b-0d6e-4e3f-b195-d003465cadaf'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:39 devstack sudo[88630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:39 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:39 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3
Apr 15 14:39:39 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:39 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Deleted volume successfully.
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=319,cinder:SELECT=240,cinder:INSERT=78,cinder:DELETE=31 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a52a6ad-27eb-4729-a4a0-8f4c1276eb39 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-46d0d552-5b66-4922-8327-cd22220284b2-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:39 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" returned: 0 in 0.713s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c49084-2c31-4826-811a-9793669fff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[850fc4f2-641c-42a6-88ff-6f9ed0a0bcc8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:40 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:40 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-af25b39c-29bc-412a-b4ae-ede24910e76c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-af25b39c-29bc-412a-b4ae-ede24910e76c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-quobyte-af25b39c-29bc-412a-b4ae-ede24910e76c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-af25b39c-29bc-412a-b4ae-ede24910e76c" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f9d1a9-b26e-4e45-9bdc-74dd8c830529]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:40 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c
Apr 15 14:39:40 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:40 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.623s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:40 devstack sudo[88644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d
Apr 15 14:39:40 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:40 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:40 devstack sudo[88649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c
Apr 15 14:39:40 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:41 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-af25b39c-29bc-412a-b4ae-ede24910e76c" returned: 0 in 0.839s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-af25b39c-29bc-412a-b4ae-ede24910e76c" released by "delete_volume" :: held 1.512s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:41 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created reservations ['1183e032-e0d4-4432-9856-0360955055f9', '80b90388-e2a9-4f83-9ac8-03aa2d7276bd', 'f95dc8b6-fb25-447d-9569-9181218713d2', 'd12be0eb-b90c-4abc-9970-f8ec4284221e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:41 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=256,cinder:UPDATE=313,cinder:DELETE=22,cinder:INSERT=83 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:42 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:42 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-66b9ad0e-6a7a-4548-964a-ca95fa45ee57-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-66b9ad0e-6a7a-4548-964a-ca95fa45ee57-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-quobyte-66b9ad0e-6a7a-4548-964a-ca95fa45ee57" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-66b9ad0e-6a7a-4548-964a-ca95fa45ee57" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa9610a-1a89-47af-b8f6-4c7162fba8ed]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:43 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57
Apr 15 14:39:43 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:43 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" returned: 0 in 2.635s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5a5f9-2fe5-4931-a3ba-65c9912c963a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:43 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.195s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Deleted volume successfully.
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1055fcc9-61d7-45ab-97ce-3e07b8280189 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-af25b39c-29bc-412a-b4ae-ede24910e76c-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:43 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:43 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Flow 'volume_create_manager' (1be7c5fc-3c3d-4d4a-8638-4ebc35200c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5e3c1f-d5d8-4c1b-af50-a21a377aa82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5e3c1f-d5d8-4c1b-af50-a21a377aa82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1101671253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e976974-a895-4200-bbec-64ec0829c6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799f44d0b04e414ab4252de36c7778f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:44Z,use_quota=True,user_id='8fdba75c663e4543bd6f5ea6e49d6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c392c59-45eb-48fb-8457-d3837378fc38),volume_type_id=2c392c59-45eb-48fb-8457-d3837378fc38)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4bc661-4010-438b-86ce-5e25d9e9205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4bc661-4010-438b-86ce-5e25d9e9205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80920636-eb23-48c3-977d-2c609a1b4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80920636-eb23-48c3-977d-2c609a1b4c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e976974-a895-4200-bbec-64ec0829c6c8', 'volume_name': 'volume-6e976974-a895-4200-bbec-64ec0829c6c8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850e5bb6-4b40-4d6d-8e6d-1f12fc2793f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850e5bb6-4b40-4d6d-8e6d-1f12fc2793f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:43 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c819c6-dce5-44ea-af43-c4989950b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Volume 6e976974-a895-4200-bbec-64ec0829c6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e976974-a895-4200-bbec-64ec0829c6c8', 'volume_size': 1}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57" returned: 0 in 0.649s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:43 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57
Apr 15 14:39:43 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:44 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.825s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53, size 1024.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:39:44 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Converted 1024.00 MB image at 388.39 MB/s
Apr 15 14:39:44 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d is being set with open permissions: ugo+rw
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:44 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d
Apr 15 14:39:44 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:44 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-66b9ad0e-6a7a-4548-964a-ca95fa45ee57" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-66b9ad0e-6a7a-4548-964a-ca95fa45ee57" released by "delete_volume" :: held 1.184s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created reservations ['4e3337dc-11b2-4419-81dc-b74b93ad4b7f', '2490ad8a-0a5f-420a-b001-2e7d9dd8e940', '5d875b6e-06de-46a6-9c93-359671f7688c', '5d369264-2264-4bb3-af2b-26d81c993ae0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:44 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:44 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:44 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" released by "_copy_volume_from_snapshot" :: held 5.438s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" released by "_create_volume_from_snapshot" :: held 5.470s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.480s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1101671253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e976974-a895-4200-bbec-64ec0829c6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799f44d0b04e414ab4252de36c7778f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:44Z,use_quota=True,user_id='8fdba75c663e4543bd6f5ea6e49d6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c392c59-45eb-48fb-8457-d3837378fc38),volume_type_id=2c392c59-45eb-48fb-8457-d3837378fc38)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Creating volume 6e976974-a895-4200-bbec-64ec0829c6c8 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:44 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8 1073741824
Apr 15 14:39:44 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a0a019-26dc-4c44-a434-8d094279ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d', 'volume_size': 1, 'snapshot_id': '09fe1e1d-85e0-461b-a5a3-c7d6956a76d3'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2493cd-c22d-4562-a867-c38c9994ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Volume volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d (a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d): created successfully
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2493cd-c22d-4562-a867-c38c9994ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Flow 'volume_create_manager' (cdbdd739-d7de-4fa6-8dd9-9f44e99071af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bacbba16-7605-418e-a2c9-3b5d03199a63 tempest-VolumesDeleteCascade-457152414 None] Created volume successfully.
Apr 15 14:39:44 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:44 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Deleted volume successfully.
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9306aaa5-789a-44fc-9678-7efb4bd9c09c tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-66b9ad0e-6a7a-4548-964a-ca95fa45ee57-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-f8f0247f-ed63-4424-9efd-1b9eb1cdd088-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-f8f0247f-ed63-4424-9efd-1b9eb1cdd088-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:45 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8 1073741824" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "cinder-quobyte-f8f0247f-ed63-4424-9efd-1b9eb1cdd088" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-f8f0247f-ed63-4424-9efd-1b9eb1cdd088" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e806ee04-ebb2-4f8a-ae41-cb82f27268ea]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:45 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8
Apr 15 14:39:45 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:45 devstack sudo[88724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088
Apr 15 14:39:45 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:45 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c819c6-dce5-44ea-af43-c4989950b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e976974-a895-4200-bbec-64ec0829c6c8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd94084-8a2c-457c-93a7-383f6c69339a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Volume volume-6e976974-a895-4200-bbec-64ec0829c6c8 (6e976974-a895-4200-bbec-64ec0829c6c8): created successfully
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd94084-8a2c-457c-93a7-383f6c69339a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Flow 'volume_create_manager' (1be7c5fc-3c3d-4d4a-8638-4ebc35200c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-73c49084-2c31-4826-811a-9793669fff53-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-310b6f63-4c16-4e66-9470-4243c6cef178 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Created volume successfully.
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-73c49084-2c31-4826-811a-9793669fff53-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Performing cascade delete. {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-73c49084-2c31-4826-811a-9793669fff53" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-73c49084-2c31-4826-811a-9793669fff53" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Deleting offline snapshot 09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 of volume 73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] snapshot_file for this snap is: volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df803ac-68f4-41c8-a997-65191d92ad9f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:46 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3
Apr 15 14:39:46 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:46 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088" returned: 0 in 0.805s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:46 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088
Apr 15 14:39:46 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:46 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" returned: 0 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c49084-2c31-4826-811a-9793669fff53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d29b3-bace-4833-80bc-c211253af159]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:46 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f8f0247f-ed63-4424-9efd-1b9eb1cdd088" returned: 0 in 0.482s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:46 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:46 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-quobyte-f8f0247f-ed63-4424-9efd-1b9eb1cdd088" released by "delete_volume" :: held 1.322s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Created reservations ['41126c52-20d9-410c-add0-811df01eae48', '15366ece-1212-46b6-ad2a-4250c94c9084', '6bdf6d82-a6e9-4399-ba39-207a686dccaf', '8b56d55e-7ee7-4bb2-abdc-a4e8e9d61170'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:46 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:46 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:47 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:47 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3
Apr 15 14:39:47 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:47 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.607s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Deleted volume successfully.
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dea6da7e-82ea-453d-823f-32788360fc00 tempest-CreateVolumesFromSourceVolumeTest-38052396 None] Lock "cinder-f8f0247f-ed63-4424-9efd-1b9eb1cdd088-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:47 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:47 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:47 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:47 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:47 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9dc1c709-e412-4c74-891b-4af50cf8fae2 tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Retype volume completed successfully.
Apr 15 14:39:48 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" returned: 0 in 0.822s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:48 devstack sudo[88761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3
Apr 15 14:39:48 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:48 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:48 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53.09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (6c508df5-f424-40cd-848b-cd01c2825f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4617dd06-4366-49e9-9ff6-7ca4a25ae6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3" released by "_delete_snapshot" :: held 2.675s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Acquiring lock "cinder-6e976974-a895-4200-bbec-64ec0829c6c8-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4617dd06-4366-49e9-9ff6-7ca4a25ae6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1355806737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbf394b-91bb-4eba-b80c-713c6dfe70b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:49Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ff0b2b-3c92-472a-b1f3-674e62547aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ff0b2b-3c92-472a-b1f3-674e62547aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51809714-04b5-4d79-b75d-aa2b3b8246c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51809714-04b5-4d79-b75d-aa2b3b8246c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efbf394b-91bb-4eba-b80c-713c6dfe70b5', 'volume_name': 'volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58724db-63c8-4e36-a390-e317b51c2872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58724db-63c8-4e36-a390-e317b51c2872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeff582-7a5a-454e-a872-48b7e11d89b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Volume efbf394b-91bb-4eba-b80c-713c6dfe70b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5', 'volume_size': 1}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1355806737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbf394b-91bb-4eba-b80c-713c6dfe70b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:49Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Creating volume efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-73c49084-2c31-4826-811a-9793669fff53" released by "delete_snapshot" :: held 2.758s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:48 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 1073741824
Apr 15 14:39:48 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "cinder-6e976974-a895-4200-bbec-64ec0829c6c8-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Acquiring lock "cinder-quobyte-6e976974-a895-4200-bbec-64ec0829c6c8" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "cinder-quobyte-6e976974-a895-4200-bbec-64ec0829c6c8" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Created reservations ['6c888465-f885-492d-ba2b-b9d2a6523411', '2e19831f-39a1-4ce7-b758-4abc812b6d38', '480b5110-300c-4abc-a146-7aa335aaca3e', '7ebd744a-4de2-4700-b166-d0bd01cd2e07'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c87228-b01f-4454-ad19-448f3448001b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Delete snapshot completed successfully.
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-09fe1e1d-85e0-461b-a5a3-c7d6956a76d3-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Snapshots deleted, issuing volume delete {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-73c49084-2c31-4826-811a-9793669fff53" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-73c49084-2c31-4826-811a-9793669fff53" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:48 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8
Apr 15 14:39:48 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb6114-7f89-4259-ab6c-c0047f87a4e8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:49 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:49 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:49 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 1073741824" returned: 0 in 0.602s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:49 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5
Apr 15 14:39:49 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:49 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8" returned: 0 in 0.587s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:49 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8
Apr 15 14:39:49 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:49 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.623s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:49 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53
Apr 15 14:39:49 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (7d479a2e-c80b-49dc-8153-a68769ee7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b577f12f-ae07-4e3e-b56b-0e18177c04b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b577f12f-ae07-4e3e-b56b-0e18177c04b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1492343069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd362e896664cf2945cbf71d12b7bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:50Z,use_quota=True,user_id='77759b5741324091977a0f37e24ed0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d44fec3-e62f-4919-ab8e-e0d407a16451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d44fec3-e62f-4919-ab8e-e0d407a16451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0ddb65-a8a2-43f4-947d-28223ccd1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0ddb65-a8a2-43f4-947d-28223ccd1828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa', 'volume_name': 'volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d72a472-e283-4a54-867c-5cc041c1eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d72a472-e283-4a54-867c-5cc041c1eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e337a3-f5fc-40e5-83be-95bbd0ff0401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Volume 0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa', 'volume_size': 1}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:49 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5" returned: 0 in 0.523s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1492343069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd362e896664cf2945cbf71d12b7bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:50Z,use_quota=True,user_id='77759b5741324091977a0f37e24ed0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Creating volume 0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:49 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:49 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeff582-7a5a-454e-a872-48b7e11d89b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:49 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa 1073741824
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bdecc8-aac0-4c49-b85b-d2fff0d85db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:49 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6e976974-a895-4200-bbec-64ec0829c6c8" returned: 0 in 0.503s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "cinder-quobyte-6e976974-a895-4200-bbec-64ec0829c6c8" released by "delete_volume" :: held 1.128s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Volume volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 (efbf394b-91bb-4eba-b80c-713c6dfe70b5): created successfully
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bdecc8-aac0-4c49-b85b-d2fff0d85db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (6c508df5-f424-40cd-848b-cd01c2825f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-48a26be1-fd47-41e1-822e-b47eb2c8571e tempest-VolumesSnapshotTestJSON-846651464 None] Created volume successfully.
Apr 15 14:39:49 devstack cinder-volume[83037]: WARNING cinder.quota [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:39:49 devstack cinder-volume[83037]: WARNING cinder.quota [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 15 14:39:49 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Created reservations ['75312a38-8bdd-4a0b-8bfa-df42cc6b4590', 'cb2d5032-ebf2-4a2f-bd87-2cb21e1efd1e', 'e2fc9ce8-1102-466e-8e3c-4ad20d4d43f2', '040421b4-0b60-4fab-bfe6-66dff78e9a23'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:50 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73c49084-2c31-4826-811a-9793669fff53" returned: 0 in 0.490s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-73c49084-2c31-4826-811a-9793669fff53" released by "delete_volume" :: held 1.162s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:50 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:50 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Created reservations ['aecc9818-2052-446c-b1fd-aeb240eb5257', '62be2306-f7d9-4252-89af-c67376a0ee58', '411e4ee1-5ace-4fa4-89cf-df6926a5bafb', '7cadfba7-f2f0-4934-a2e8-a9e9c04ecb2a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:50 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:50 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:50 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa 1073741824" returned: 0 in 0.537s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "cinder-quobyte-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:50 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.467s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:50 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:39:50 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1b523a-39bf-4333-850b-f9ed4c04baae]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Deleted volume successfully.
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e43d9ff7-89e9-4cdf-b391-faa309c10ffa tempest-VolumeRetypeWithoutMigrationTest-1706740317 None] Lock "cinder-6e976974-a895-4200-bbec-64ec0829c6c8-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:50 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d
Apr 15 14:39:50 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:50 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Deleted volume successfully.
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aa4bacd6-d925-4c64-916f-7f689b15fa97 tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-73c49084-2c31-4826-811a-9793669fff53-delete_volume" released by "delete_volume" :: held 4.732s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:50 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e337a3-f5fc-40e5-83be-95bbd0ff0401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad471468-87d1-4057-a2de-98a26f5affa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Volume volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa (0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa): created successfully
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad471468-87d1-4057-a2de-98a26f5affa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (7d479a2e-c80b-49dc-8153-a68769ee7276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8b4cd76e-7db6-4660-aec6-3b43f4eba0c9 tempest-VolumeDependencyTests-1676476263 None] Created volume successfully.
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Creating offline snapshot c9281fe9-e482-4cc7-bd45-b4d674b6718a of volume efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e4e575-ef78-432f-bea9-22c5bdce3a86]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:51 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:51 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d
Apr 15 14:39:51 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:51 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5
Apr 15 14:39:51 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:51 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-quobyte-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d" released by "delete_volume" :: held 1.089s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Created reservations ['3636ddc1-162c-46bd-b7c7-d052ad9230e9', 'f776fb46-40bc-43a2-ad18-d5358c25228f', 'e9aa778b-0676-43a9-becf-b7e9bfc4308d', '091d3b08-f613-48a0-8256-5623ffddcbd9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:51 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:51 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:39:51 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:51 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a 1G
Apr 15 14:39:51 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:52 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.476s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:39:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Deleted volume successfully.
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f9652024-9798-4f1b-9c20-0d1ef9cae33b tempest-VolumesDeleteCascade-457152414 None] Lock "cinder-a6c49b3c-8e6f-45eb-986c-61c7bdc58f1d-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:52 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a 1G" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:52 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a
Apr 15 14:39:52 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:52 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:52 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a is being set with open permissions: ugo+rw
Apr 15 14:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:52 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a
Apr 15 14:39:52 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:53 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:53 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info
Apr 15 14:39:53 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:53 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info" returned: 0 in 0.555s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info is being set with open permissions: ugo+rw
Apr 15 14:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:53 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info
Apr 15 14:39:53 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:54 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.info" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.431s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.425s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Creating offline snapshot bf3e6bc1-c2c3-44b4-9709-a3a032211ffd of volume 0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:39:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[27590487-612e-41e8-afcd-e8c155f8cf9e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3b163e41-325a-48fd-bd86-abd59c6408a6 tempest-VolumesSnapshotTestJSON-846651464 None] Create snapshot completed successfully
Apr 15 14:39:54 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:39:54 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:55 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.668s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:55 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd 1G
Apr 15 14:39:55 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-c9281fe9-e482-4cc7-bd45-b4d674b6718a-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-c9281fe9-e482-4cc7-bd45-b4d674b6718a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-efbf394b-91bb-4eba-b80c-713c6dfe70b5" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-efbf394b-91bb-4eba-b80c-713c6dfe70b5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-c9281fe9-e482-4cc7-bd45-b4d674b6718a" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-c9281fe9-e482-4cc7-bd45-b4d674b6718a" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Deleting offline snapshot c9281fe9-e482-4cc7-bd45-b4d674b6718a of volume efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] snapshot_file for this snap is: volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeda88e-fefc-4a51-bf30-4b348fca798f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:55 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a
Apr 15 14:39:55 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Flow 'volume_create_manager' (e669b180-cf34-47e3-b5d4-7566f3e35bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192183ba-8ccf-4b15-90b4-37eb2896ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192183ba-8ccf-4b15-90b4-37eb2896ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-631168926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a745a0-6387-41b5-93bf-76d9d661680e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f99cf0ab817463484a806c09860e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:56Z,use_quota=True,user_id='2e5ce1706f4240688cbf960297958dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fe595e-24b7-431d-a8bb-4e9d38dd77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fe595e-24b7-431d-a8bb-4e9d38dd77da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcfe50f-f263-4477-8669-6a71f108633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcfe50f-f263-4477-8669-6a71f108633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a745a0-6387-41b5-93bf-76d9d661680e', 'volume_name': 'volume-30a745a0-6387-41b5-93bf-76d9d661680e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938c477a-4836-4258-a423-d0f2a2b4c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938c477a-4836-4258-a423-d0f2a2b4c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5444cb90-4cb2-4e5a-ae25-86d00bdb075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:55 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Volume 30a745a0-6387-41b5-93bf-76d9d661680e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a745a0-6387-41b5-93bf-76d9d661680e', 'volume_size': 1}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:55 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd 1G" returned: 0 in 0.614s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:55 devstack sudo[88851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd
Apr 15 14:39:55 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:55 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a" returned: 0 in 0.604s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f58d7af-3585-465b-88ed-417fc439962e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:56 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5
Apr 15 14:39:56 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:56 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd is being set with open permissions: ugo+rw
Apr 15 14:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:56 devstack sudo[88861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd
Apr 15 14:39:56 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:56 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:56 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a
Apr 15 14:39:56 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:56 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:56 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info
Apr 15 14:39:56 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:57 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:57 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a
Apr 15 14:39:57 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:57 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:57 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info is being set with open permissions: ugo+rw
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:57 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info
Apr 15 14:39:57 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:57 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5.c9281fe9-e482-4cc7-bd45-b4d674b6718a" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-c9281fe9-e482-4cc7-bd45-b4d674b6718a" released by "_delete_snapshot" :: held 2.277s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-efbf394b-91bb-4eba-b80c-713c6dfe70b5" released by "delete_snapshot" :: held 2.288s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:57 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['56346acd-9e10-4ec1-abda-08a7140fb623', '3e5fd225-560f-45c5-9897-a7c2665d017c', '2165d868-93b7-4d0e-84f1-365596c8dfef', '106cffcc-52cd-4c35-934e-4ec1ac695646'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.info" returned: 0 in 0.464s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.241s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-631168926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a745a0-6387-41b5-93bf-76d9d661680e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f99cf0ab817463484a806c09860e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:56Z,use_quota=True,user_id='2e5ce1706f4240688cbf960297958dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Creating volume 30a745a0-6387-41b5-93bf-76d9d661680e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:57 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:57 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e 1073741824
Apr 15 14:39:57 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e19b1933-8171-4e32-8c81-9d95f3a56647 tempest-VolumeDependencyTests-1676476263 None] Create snapshot completed successfully
Apr 15 14:39:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Delete snapshot completed successfully.
Apr 15 14:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7097a9-7a67-4023-a669-2a838659da99 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-c9281fe9-e482-4cc7-bd45-b4d674b6718a-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:39:58 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e 1073741824" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:58 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e
Apr 15 14:39:58 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (d23b9084-2028-4f9c-994a-e9268eaeb213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb75cca7-6a16-4be7-bf1b-8723d6f98cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb75cca7-6a16-4be7-bf1b-8723d6f98cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-688043723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9560a18-b5ac-4e67-920f-9e1ee885f864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd362e896664cf2945cbf71d12b7bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf3e6bc1-c2c3-44b4-9709-a3a032211ffd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:59Z,use_quota=True,user_id='77759b5741324091977a0f37e24ed0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f46db1-2ecd-4c67-b6d8-46b377fa7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f46db1-2ecd-4c67-b6d8-46b377fa7549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8897d9-d98b-41b2-9d9a-167ae4754f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8897d9-d98b-41b2-9d9a-167ae4754f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9560a18-b5ac-4e67-920f-9e1ee885f864', 'volume_name': 'volume-b9560a18-b5ac-4e67-920f-9e1ee885f864', 'volume_size': 1, 'snapshot_id': 'bf3e6bc1-c2c3-44b4-9709-a3a032211ffd'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5c77d-13e3-485b-b971-659f0ea0472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b5c77d-13e3-485b-b971-659f0ea0472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dcc2d9-1e40-416c-b5a1-7913c0148d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Volume b9560a18-b5ac-4e67-920f-9e1ee885f864: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9560a18-b5ac-4e67-920f-9e1ee885f864', 'volume_size': 1, 'snapshot_id': 'bf3e6bc1-c2c3-44b4-9709-a3a032211ffd'}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:58 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (730feaba-40b9-4845-95f5-278a3a870288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed49a6c-1693-42ad-8040-9cb1346faf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e" returned: 0 in 0.619s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.132s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd-b9560a18-b5ac-4e67-920f-9e1ee885f864" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed49a6c-1693-42ad-8040-9cb1346faf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-349027223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d123499a-56dd-431f-9178-be27563b7403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:59Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663ab5d6-34d7-480c-aa99-3d64a7a1936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663ab5d6-34d7-480c-aa99-3d64a7a1936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a899225c-fc3c-436f-b330-c323570cb08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a899225c-fc3c-436f-b330-c323570cb08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd123499a-56dd-431f-9178-be27563b7403', 'volume_name': 'volume-d123499a-56dd-431f-9178-be27563b7403', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78321fbf-0827-479d-8692-cea28434bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78321fbf-0827-479d-8692-cea28434bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c1355a-ee98-46cd-beb5-ec088fcc7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Volume d123499a-56dd-431f-9178-be27563b7403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d123499a-56dd-431f-9178-be27563b7403', 'volume_size': 1}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5444cb90-4cb2-4e5a-ae25-86d00bdb075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a745a0-6387-41b5-93bf-76d9d661680e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fe61dd-84b3-4131-88ad-b2f306350d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd-b9560a18-b5ac-4e67-920f-9e1ee885f864" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Creating volume b9560a18-b5ac-4e67-920f-9e1ee885f864 from snapshot bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-b9560a18-b5ac-4e67-920f-9e1ee885f864" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:39:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Volume volume-30a745a0-6387-41b5-93bf-76d9d661680e (30a745a0-6387-41b5-93bf-76d9d661680e): created successfully
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fe61dd-84b3-4131-88ad-b2f306350d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Flow 'volume_create_manager' (e669b180-cf34-47e3-b5d4-7566f3e35bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-b9560a18-b5ac-4e67-920f-9e1ee885f864" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] snapshot: bf3e6bc1-c2c3-44b4-9709-a3a032211ffd, volume: b9560a18-b5ac-4e67-920f-9e1ee885f864,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:39:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-11597f74-2bdb-4534-8942-83f85abf97c0 tempest-VolumesTransfersV355Test-1481476225 None] Created volume successfully.
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2f7161-5ef0-493c-ba3e-d26a118fa9bb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:59 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd
Apr 15 14:39:59 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:39:59 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 15 14:39:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:39:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:39:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:39:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:39:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3715189-21d7-4852-85bd-fdd390b101b0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:39:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:39:59 devstack sudo[88895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:39:59 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:00 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:00 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:40:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:00 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864
Apr 15 14:40:00 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e8e4ace-39de-465c-b605-5b9442b413cd tempest-VolumesTransfersV355Test-551451970 None] Transfer volume completed successfully.
Apr 15 14:40:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Acquiring lock "cinder-30a745a0-6387-41b5-93bf-76d9d661680e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-30a745a0-6387-41b5-93bf-76d9d661680e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Acquiring lock "cinder-quobyte-30a745a0-6387-41b5-93bf-76d9d661680e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-quobyte-30a745a0-6387-41b5-93bf-76d9d661680e" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df1bc0-1dca-4def-a2b7-6e2a0912570e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:02 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e
Apr 15 14:40:02 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:02 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864" returned: 0 in 2.520s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9165be-b1ba-4bdf-9618-5f4f069fe67e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:02 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:40:02 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:02 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e" returned: 0 in 1.106s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:02 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e
Apr 15 14:40:02 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Flow 'volume_create_manager' (2e424ebb-5c97-4839-8f5d-2a8585c4b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b84c8c9-f2dd-4686-93f3-a4cc2beec034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b84c8c9-f2dd-4686-93f3-a4cc2beec034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-805116110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679c0198-5e14-4bfc-b663-32c98eb29f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6963157657c948fa9e907538cc59c70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:03Z,use_quota=True,user_id='427de06a800d483a85b450c55dd39e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3e024-5374-4990-b135-9eb9abdd91df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3e024-5374-4990-b135-9eb9abdd91df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1597a665-476e-4725-b159-c2a270ff473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1597a665-476e-4725-b159-c2a270ff473e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679c0198-5e14-4bfc-b663-32c98eb29f29', 'volume_name': 'volume-679c0198-5e14-4bfc-b663-32c98eb29f29', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bbdaa4-b997-4ae5-b439-9a28efadadb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bbdaa4-b997-4ae5-b439-9a28efadadb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b22d9-590d-4893-816f-7da359a2475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Volume 679c0198-5e14-4bfc-b663-32c98eb29f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679c0198-5e14-4bfc-b663-32c98eb29f29', 'volume_size': 1}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:03 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.703s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:40:03 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Converted 1024.00 MB image at 406.13 MB/s
Apr 15 14:40:03 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 is being set with open permissions: ugo+rw
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:03 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-30a745a0-6387-41b5-93bf-76d9d661680e" returned: 0 in 0.444s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:03 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864
Apr 15 14:40:03 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-quobyte-30a745a0-6387-41b5-93bf-76d9d661680e" released by "delete_volume" :: held 1.604s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Created reservations ['02592511-a368-44cc-8f3e-994b3d77460b', '7b6e4340-814d-4c4a-9c3d-b4acaa91f0d7', '93cfa130-b5b0-47c3-9035-5bf9578d0382', 'dd110314-8545-48f6-b143-6ebd4d362099'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:03 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:03 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:03 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864" returned: 0 in 0.415s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-b9560a18-b5ac-4e67-920f-9e1ee885f864" released by "_copy_volume_from_snapshot" :: held 4.810s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd-b9560a18-b5ac-4e67-920f-9e1ee885f864" released by "_create_volume_from_snapshot" :: held 4.834s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.878s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.858s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-349027223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d123499a-56dd-431f-9178-be27563b7403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:39:59Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Creating volume d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:03 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:03 devstack sudo[88932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 1073741824
Apr 15 14:40:03 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dcc2d9-1e40-416c-b5a1-7913c0148d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9560a18-b5ac-4e67-920f-9e1ee885f864', 'volume_size': 1, 'snapshot_id': 'bf3e6bc1-c2c3-44b4-9709-a3a032211ffd'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62ae4f-2bdf-4a47-883a-45b1899d5747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Volume volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 (b9560a18-b5ac-4e67-920f-9e1ee885f864): created successfully
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62ae4f-2bdf-4a47-883a-45b1899d5747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (d23b9084-2028-4f9c-994a-e9268eaeb213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-14d796bf-cad1-4a5c-9bf7-92f175fdf1c6 tempest-VolumeDependencyTests-1676476263 None] Created volume successfully.
Apr 15 14:40:03 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Deleted volume successfully.
Apr 15 14:40:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-108b7aa7-5307-4cbd-a2ac-c18544e0dee7 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-30a745a0-6387-41b5-93bf-76d9d661680e-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Deleting offline snapshot bf3e6bc1-c2c3-44b4-9709-a3a032211ffd of volume 0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] snapshot_file for this snap is: volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a717698e-64b9-42bb-b97b-662f5298bf29]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:04 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd
Apr 15 14:40:04 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Flow 'volume_create_manager' (667d26da-b3dd-4ced-add2-82db0fe270c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728956e1-9276-46ca-9138-935adf450760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728956e1-9276-46ca-9138-935adf450760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1182070631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485f93fa-d296-4903-a3a7-a006aaea7c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f99cf0ab817463484a806c09860e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:04Z,use_quota=True,user_id='2e5ce1706f4240688cbf960297958dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f78d00-4b7f-4dbf-89a9-facd13fd81af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f78d00-4b7f-4dbf-89a9-facd13fd81af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186c9757-c787-478a-a47e-14f5bc283c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186c9757-c787-478a-a47e-14f5bc283c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485f93fa-d296-4903-a3a7-a006aaea7c6e', 'volume_name': 'volume-485f93fa-d296-4903-a3a7-a006aaea7c6e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d33ffa-aa9b-4d41-ad7a-3492777dcef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d33ffa-aa9b-4d41-ad7a-3492777dcef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d5ca92-9e89-44d4-8335-ef5017a6b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Volume 485f93fa-d296-4903-a3a7-a006aaea7c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485f93fa-d296-4903-a3a7-a006aaea7c6e', 'volume_size': 1}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:04 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 1073741824" returned: 0 in 0.567s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:04 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:04 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:04 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bbccb9-8c6b-453b-8c67-185342ec3582]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:04 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:40:04 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:04 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-805116110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679c0198-5e14-4bfc-b663-32c98eb29f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6963157657c948fa9e907538cc59c70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:03Z,use_quota=True,user_id='427de06a800d483a85b450c55dd39e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Creating volume 679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:04 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c1355a-ee98-46cd-beb5-ec088fcc7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d123499a-56dd-431f-9178-be27563b7403', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:04 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 1073741824
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32bf38-2c57-4fe0-a4b7-ee63b429e49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:04 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Volume volume-d123499a-56dd-431f-9178-be27563b7403 (d123499a-56dd-431f-9178-be27563b7403): created successfully
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32bf38-2c57-4fe0-a4b7-ee63b429e49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (730feaba-40b9-4845-95f5-278a3a870288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9753943e-6611-45e9-b9ae-b456d415fb97 tempest-VolumesSnapshotTestJSON-846651464 None] Created volume successfully.
Apr 15 14:40:05 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:05 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd
Apr 15 14:40:05 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:05 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 1073741824" returned: 0 in 0.592s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:05 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:40:05 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:05 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:05 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd
Apr 15 14:40:05 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:05 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.443s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1182070631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485f93fa-d296-4903-a3a7-a006aaea7c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f99cf0ab817463484a806c09860e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:04Z,use_quota=True,user_id='2e5ce1706f4240688cbf960297958dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Creating volume 485f93fa-d296-4903-a3a7-a006aaea7c6e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b22d9-590d-4893-816f-7da359a2475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679c0198-5e14-4bfc-b663-32c98eb29f29', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:05 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e 1073741824
Apr 15 14:40:05 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309341c1-51c4-4013-a33e-d18d53226794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Volume volume-679c0198-5e14-4bfc-b663-32c98eb29f29 (679c0198-5e14-4bfc-b663-32c98eb29f29): created successfully
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309341c1-51c4-4013-a33e-d18d53226794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Flow 'volume_create_manager' (2e424ebb-5c97-4839-8f5d-2a8585c4b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bee6e738-3511-4577-892d-83330740226f tempest-VolumesActionsTest-292559922 None] Created volume successfully.
Apr 15 14:40:06 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa.bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" returned: 0 in 0.428s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd" released by "_delete_snapshot" :: held 2.046s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" released by "delete_snapshot" :: held 2.067s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Created reservations ['9cd210da-6b1f-41f0-97d3-c4ce7bf438ea', 'ad10c651-3194-4bde-99e7-cb16ec91a266', '7273ab89-a6a6-426e-a281-b4ef1ca70044', 'f7223f92-9056-482f-98cc-3b1a37475ca5'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Delete snapshot completed successfully.
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-42399439-a45c-4fe8-b649-0a40d24a281d tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-bf3e6bc1-c2c3-44b4-9709-a3a032211ffd-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:06 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e 1073741824" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:06 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e
Apr 15 14:40:06 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:07 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e" returned: 0 in 0.476s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.580s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d5ca92-9e89-44d4-8335-ef5017a6b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485f93fa-d296-4903-a3a7-a006aaea7c6e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06e3f9e-367c-4932-80ae-2f2b26665a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Volume volume-485f93fa-d296-4903-a3a7-a006aaea7c6e (485f93fa-d296-4903-a3a7-a006aaea7c6e): created successfully
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06e3f9e-367c-4932-80ae-2f2b26665a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Flow 'volume_create_manager' (667d26da-b3dd-4ced-add2-82db0fe270c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Creating offline snapshot c24542e1-e3d4-42ee-8219-383e32c2b783 of volume d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:40:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-392f3d0a-eefb-46cd-bbf2-baa10377a5d1 tempest-VolumesTransfersV355Test-1481476225 None] Created volume successfully.
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5debc681-61e3-44d8-bd5a-ed8aaf140d3c]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:07 devstack sudo[88977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:07 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[be48f472-6288-45e7-b9e5-188313531223]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:07 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:40:07 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Acquiring lock "cinder-485f93fa-d296-4903-a3a7-a006aaea7c6e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-485f93fa-d296-4903-a3a7-a006aaea7c6e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Acquiring lock "cinder-quobyte-485f93fa-d296-4903-a3a7-a006aaea7c6e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-quobyte-485f93fa-d296-4903-a3a7-a006aaea7c6e" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f674c9-28ca-4f83-b9b0-417ad9bc110a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:07 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 0.586s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:07 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 1G
Apr 15 14:40:07 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:07 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e
Apr 15 14:40:07 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:07 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.592s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:07 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa
Apr 15 14:40:07 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:08 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 1G" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d123499a-56dd-431f-9178-be27563b7403 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:08 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d123499a-56dd-431f-9178-be27563b7403 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783
Apr 15 14:40:08 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:08 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:08 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e
Apr 15 14:40:08 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:08 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa" released by "delete_volume" :: held 1.129s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Created reservations ['908f9a1d-bb5c-4841-9e4a-67eaea8ddc83', '61082022-d945-475c-add8-67d2bf6a56b2', '93ef8294-cae8-448b-9da0-6be49425d2c5', 'fe8a7cdc-11f2-4257-b9e4-89a7c80c3dfc'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:08 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:08 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:08 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d123499a-56dd-431f-9178-be27563b7403 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:08 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 is being set with open permissions: ugo+rw
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:08 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783
Apr 15 14:40:08 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:08 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-485f93fa-d296-4903-a3a7-a006aaea7c6e" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-quobyte-485f93fa-d296-4903-a3a7-a006aaea7c6e" released by "delete_volume" :: held 1.155s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Created reservations ['9fe7e854-fa7d-4f5d-8add-b2d6f552fc37', '06cec029-092d-44fc-987e-44f816e53704', 'f6bb3aca-695a-448f-a1ea-3654621d6df5', 'ee52213b-c416-4a1b-935b-25bb7a293068'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:08 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:08 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:08 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:08 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Deleted volume successfully.
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8f27b22d-66e8-4c29-b147-0b5307c79fd5 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-0db7152a-07d2-47b4-b4a6-6fb2d9ed8aaa-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:09 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783" returned: 0 in 0.418s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:09 devstack sudo[89018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info
Apr 15 14:40:09 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:09 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Deleted volume successfully.
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e39a79c-5ca2-4744-8121-87fa6d7bc5c9 tempest-VolumesTransfersV355Test-102683053 None] Lock "cinder-485f93fa-d296-4903-a3a7-a006aaea7c6e-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:09 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:09 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info is being set with open permissions: ugo+rw
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:09 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info
Apr 15 14:40:09 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (2c479e1b-8ce5-4787-b714-e1fb546f7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8294a0-92e9-4037-aa18-a9594c03ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8294a0-92e9-4037-aa18-a9594c03ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-621992170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ce9dae-acc7-492d-9eca-8dcc67e40765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd362e896664cf2945cbf71d12b7bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:10Z,use_quota=True,user_id='77759b5741324091977a0f37e24ed0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652a34b0-2fc2-456a-b2d9-2e9fd475e560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652a34b0-2fc2-456a-b2d9-2e9fd475e560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4667e10a-b570-41f0-a91b-7342e7495e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4667e10a-b570-41f0-a91b-7342e7495e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ce9dae-acc7-492d-9eca-8dcc67e40765', 'volume_name': 'volume-97ce9dae-acc7-492d-9eca-8dcc67e40765', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486ecea1-36d4-420b-8d50-f366a7f507fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486ecea1-36d4-420b-8d50-f366a7f507fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f239dc1-b630-4199-a855-d69a4227543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Volume 97ce9dae-acc7-492d-9eca-8dcc67e40765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ce9dae-acc7-492d-9eca-8dcc67e40765', 'volume_size': 1}
Apr 15 14:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:10 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.info" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.983s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-621992170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ce9dae-acc7-492d-9eca-8dcc67e40765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd362e896664cf2945cbf71d12b7bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:10Z,use_quota=True,user_id='77759b5741324091977a0f37e24ed0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Creating volume 97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:10 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:10 devstack sudo[89025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 1073741824
Apr 15 14:40:10 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-fd5954da-508e-4aa5-8291-09aaf05d4f5e tempest-VolumesSnapshotTestJSON-846651464 None] Create snapshot completed successfully
Apr 15 14:40:10 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 1073741824" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:10 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:10 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (e7bc603e-4e7b-4c15-bf25-bd92558fdf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4acdb2-4a8a-425c-8839-e2793334beba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4acdb2-4a8a-425c-8839-e2793334beba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-475465956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c24e0-8fc6-4330-a81e-7615b969f3f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c24542e1-e3d4-42ee-8219-383e32c2b783,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:11Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2608edbd-6b48-4eea-9fcb-19877d187de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2608edbd-6b48-4eea-9fcb-19877d187de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16b29ef-34f1-46dc-944b-1b2d1e7897a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16b29ef-34f1-46dc-944b-1b2d1e7897a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f96c24e0-8fc6-4330-a81e-7615b969f3f5', 'volume_name': 'volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5', 'volume_size': 2, 'snapshot_id': 'c24542e1-e3d4-42ee-8219-383e32c2b783'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9539189-d16a-4cfe-9ff0-e7fe0f8900d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9539189-d16a-4cfe-9ff0-e7fe0f8900d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f28a21-f5de-491a-ba10-f89b863b9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Volume f96c24e0-8fc6-4330-a81e-7615b969f3f5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5', 'volume_size': 2, 'snapshot_id': 'c24542e1-e3d4-42ee-8219-383e32c2b783'}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:11 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.465s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.049s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-c24542e1-e3d4-42ee-8219-383e32c2b783-f96c24e0-8fc6-4330-a81e-7615b969f3f5" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f239dc1-b630-4199-a855-d69a4227543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ce9dae-acc7-492d-9eca-8dcc67e40765', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86588b9-5db9-4676-b867-0d3d85111d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-c24542e1-e3d4-42ee-8219-383e32c2b783-f96c24e0-8fc6-4330-a81e-7615b969f3f5" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Creating volume f96c24e0-8fc6-4330-a81e-7615b969f3f5 from snapshot c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-f96c24e0-8fc6-4330-a81e-7615b969f3f5" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Volume volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 (97ce9dae-acc7-492d-9eca-8dcc67e40765): created successfully
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86588b9-5db9-4676-b867-0d3d85111d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (2c479e1b-8ce5-4787-b714-e1fb546f7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1ce4d880-6bed-405c-a2af-57d603cd46c5 tempest-VolumeDependencyTests-1676476263 None] Created volume successfully.
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-f96c24e0-8fc6-4330-a81e-7615b969f3f5" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] snapshot: c24542e1-e3d4-42ee-8219-383e32c2b783, volume: f96c24e0-8fc6-4330-a81e-7615b969f3f5,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76ef230-4997-429f-9f56-62a6380ccec6]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:11 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783
Apr 15 14:40:11 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:11 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783" returned: 0 in 0.655s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d123499a-56dd-431f-9178-be27563b7403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dc84fd-74bd-49b6-a346-54dd18a9d882]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:11 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:11 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (168d4fb9-430b-4610-a21d-fcd7eeb48e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a004df-d844-43dc-9f2b-93e7edc7960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a004df-d844-43dc-9f2b-93e7edc7960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-626991090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341a7c99-a81d-4baf-903e-5afe1937f63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd362e896664cf2945cbf71d12b7bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=97ce9dae-acc7-492d-9eca-8dcc67e40765,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:12Z,use_quota=True,user_id='77759b5741324091977a0f37e24ed0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb3513c-1f21-4899-91e9-10d5214ae9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb3513c-1f21-4899-91e9-10d5214ae9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff8f19c-ea25-4186-8f70-702e5740dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff8f19c-ea25-4186-8f70-702e5740dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '341a7c99-a81d-4baf-903e-5afe1937f63c', 'volume_name': 'volume-341a7c99-a81d-4baf-903e-5afe1937f63c', 'volume_size': 1, 'source_volid': '97ce9dae-acc7-492d-9eca-8dcc67e40765', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001391fd-f653-4138-a86d-395d4bd99562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001391fd-f653-4138-a86d-395d4bd99562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002ec9cd-0190-4430-b3ee-494446e2d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Volume 341a7c99-a81d-4baf-903e-5afe1937f63c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-341a7c99-a81d-4baf-903e-5afe1937f63c', 'volume_size': 1, 'source_volid': '97ce9dae-acc7-492d-9eca-8dcc67e40765', 'source_volstatus': 'available'}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:12 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 0.660s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:12 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5
Apr 15 14:40:12 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:15 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5" returned: 0 in 2.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fbcce9-72a8-45a1-b65c-bb1ddfbc9278]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:15 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:15 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:15 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 0.701s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:40:15 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Converted 1024.00 MB image at 408.22 MB/s
Apr 15 14:40:15 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 is being set with open permissions: ugo+rw
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:15 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5
Apr 15 14:40:15 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Flow 'volume_create_manager' (9274cbfc-8ae1-4989-813f-5125eb93c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ef4298-876b-4ff8-a008-77bcc596782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ef4298-876b-4ff8-a008-77bcc596782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-521694122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10702ffe-d91e-4fa7-826f-fd5968752e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df59b5059a5748cfb44bce15326a23e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:16Z,use_quota=True,user_id='24e8bf2d23e0467fb78a1c2dea122d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a7b426-6639-4141-af71-affd4da30dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a7b426-6639-4141-af71-affd4da30dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688da4f9-4749-4aec-b159-5af9825b931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688da4f9-4749-4aec-b159-5af9825b931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10702ffe-d91e-4fa7-826f-fd5968752e0d', 'volume_name': 'volume-10702ffe-d91e-4fa7-826f-fd5968752e0d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9ecb64-8f83-47d7-a368-9662969980c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9ecb64-8f83-47d7-a368-9662969980c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f0b147-afa9-4532-a70b-45b823c16f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Volume 10702ffe-d91e-4fa7-826f-fd5968752e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10702ffe-d91e-4fa7-826f-fd5968752e0d', 'volume_size': 1}
Apr 15 14:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:16 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5" returned: 0 in 0.407s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-f96c24e0-8fc6-4330-a81e-7615b969f3f5" released by "_copy_volume_from_snapshot" :: held 4.987s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-c24542e1-e3d4-42ee-8219-383e32c2b783-f96c24e0-8fc6-4330-a81e-7615b969f3f5" released by "_create_volume_from_snapshot" :: held 5.032s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.054s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.900s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:16 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Cloning volume 97ce9dae-acc7-492d-9eca-8dcc67e40765 to volume 341a7c99-a81d-4baf-903e-5afe1937f63c
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f28a21-f5de-491a-ba10-f89b863b9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5', 'volume_size': 2, 'snapshot_id': 'c24542e1-e3d4-42ee-8219-383e32c2b783'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994761a7-0ffd-4834-8c83-375daeedfe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Volume volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 (f96c24e0-8fc6-4330-a81e-7615b969f3f5): created successfully
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994761a7-0ffd-4834-8c83-375daeedfe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (e7bc603e-4e7b-4c15-bf25-bd92558fdf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Creating offline snapshot b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 of volume 97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401b3c0-4d25-4967-8ec3-f661eac73c8e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-78084332-92f7-4b02-ad3f-46cae4c2d7d9 tempest-VolumesSnapshotTestJSON-846651464 None] Created volume successfully.
Apr 15 14:40:16 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:16 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-f96c24e0-8fc6-4330-a81e-7615b969f3f5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-f96c24e0-8fc6-4330-a81e-7615b969f3f5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-f96c24e0-8fc6-4330-a81e-7615b969f3f5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-f96c24e0-8fc6-4330-a81e-7615b969f3f5" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ccc7ab-4ed8-4a50-bec8-61d8f673b59c]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:16 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5
Apr 15 14:40:16 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:16 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.503s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:16 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 1G
Apr 15 14:40:16 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:17 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:17 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5
Apr 15 14:40:17 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:17 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 1G" returned: 0 in 0.524s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:17 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6
Apr 15 14:40:17 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:17 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-f96c24e0-8fc6-4330-a81e-7615b969f3f5" returned: 0 in 0.418s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-f96c24e0-8fc6-4330-a81e-7615b969f3f5" released by "delete_volume" :: held 0.980s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['6c945f41-bcf9-45a1-8cd2-006bc2da6965', '8e6115a7-24c2-4820-9bed-c796eacc05af', 'dbf47952-6dbc-4aae-aeb0-1bdf41167193', '58ff56c1-0234-43ae-99cc-aea6112d77a5'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:17 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:17 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-c24542e1-e3d4-42ee-8219-383e32c2b783-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-c24542e1-e3d4-42ee-8219-383e32c2b783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-d123499a-56dd-431f-9178-be27563b7403" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-d123499a-56dd-431f-9178-be27563b7403" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-c24542e1-e3d4-42ee-8219-383e32c2b783" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-c24542e1-e3d4-42ee-8219-383e32c2b783" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Deleting offline snapshot c24542e1-e3d4-42ee-8219-383e32c2b783 of volume d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] snapshot_file for this snap is: volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a6d5b9-f088-4782-b2e2-66ecf32245a7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:17 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:17 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 is being set with open permissions: ugo+rw
Apr 15 14:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:17 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6
Apr 15 14:40:17 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:17 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783
Apr 15 14:40:17 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:18 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.467s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Deleted volume successfully.
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59bbb0b7-2d23-44f7-b509-4931c61c5f0a tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-f96c24e0-8fc6-4330-a81e-7615b969f3f5-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:18 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" returned: 0 in 0.439s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:18 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info
Apr 15 14:40:18 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:18 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d123499a-56dd-431f-9178-be27563b7403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3345214b-99f7-402c-933f-32d0d9c237e2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:18 devstack sudo[89119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:18 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:18 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info" returned: 0 in 0.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:18 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info is being set with open permissions: ugo+rw
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:18 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info
Apr 15 14:40:18 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:18 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:18 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783
Apr 15 14:40:18 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:19 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.info" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-341a7c99-a81d-4baf-903e-5afe1937f63c" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-341a7c99-a81d-4baf-903e-5afe1937f63c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] snapshot: b43a9cba-840e-44d8-b156-c3eb7b4ec7f6, volume: 341a7c99-a81d-4baf-903e-5afe1937f63c,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d3d70-1452-4940-b71d-8ee48e180ba0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:19 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6
Apr 15 14:40:19 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:19 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783" returned: 0 in 0.493s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:19 devstack sudo[89135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783
Apr 15 14:40:19 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:19 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ce9dae-acc7-492d-9eca-8dcc67e40765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce7285-803c-4789-aa66-596be085bbed]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:19 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:19 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403.c24542e1-e3d4-42ee-8219-383e32c2b783" returned: 0 in 0.458s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:19 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-c24542e1-e3d4-42ee-8219-383e32c2b783" released by "_delete_snapshot" :: held 2.102s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-d123499a-56dd-431f-9178-be27563b7403" released by "delete_snapshot" :: held 2.118s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['3a21e38e-b924-4502-8684-9adbc882f1b4', '7fe54b0f-1228-4e44-a3ac-bd8e3c25bf23', '31be0557-86d3-49f4-93a4-5a25afd9416b', '507ddd52-56df-4e76-badd-086dac5c10b0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Delete snapshot completed successfully.
Apr 15 14:40:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99aee902-e2ba-45f1-b754-3631576dc684 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-c24542e1-e3d4-42ee-8219-383e32c2b783-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:20 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.713s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:20 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:40:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:20 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c
Apr 15 14:40:20 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-d123499a-56dd-431f-9178-be27563b7403-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-d123499a-56dd-431f-9178-be27563b7403-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-d123499a-56dd-431f-9178-be27563b7403" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-d123499a-56dd-431f-9178-be27563b7403" acquired by "delete_volume" :: waited 0.025s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b24ec7-1ead-435f-b1b8-629fb5c937ee]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:21 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:21 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b7814f9-9cff-475c-9aa1-7eccbdc3dab7 tempest-VolumesActionsTest-292559922 None] Acquiring lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29" by "attach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b7814f9-9cff-475c-9aa1-7eccbdc3dab7 tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29" acquired by "attach_volume" :: waited 0.042s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6b7814f9-9cff-475c-9aa1-7eccbdc3dab7 tempest-VolumesActionsTest-292559922 None] Attaching volume 679c0198-5e14-4bfc-b663-32c98eb29f29 to instance ea12e870-8662-4d95-87cf-e6810b96b144 at mountpoint /dev/vdb on host None.
Apr 15 14:40:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6b7814f9-9cff-475c-9aa1-7eccbdc3dab7 tempest-VolumesActionsTest-292559922 None] Attach volume completed successfully.
Apr 15 14:40:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b7814f9-9cff-475c-9aa1-7eccbdc3dab7 tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29" released by "attach_volume" :: held 0.448s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-743a1b32-8f79-48f0-839e-adc901844267 tempest-VolumesActionsTest-292559922 None] Acquiring lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-743a1b32-8f79-48f0-839e-adc901844267 tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-743a1b32-8f79-48f0-839e-adc901844267 tempest-VolumesActionsTest-292559922 None] Detaching volume 679c0198-5e14-4bfc-b663-32c98eb29f29 from instance ea12e870-8662-4d95-87cf-e6810b96b144.
Apr 15 14:40:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-743a1b32-8f79-48f0-839e-adc901844267 tempest-VolumesActionsTest-292559922 None] Detach volume completed successfully.
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-743a1b32-8f79-48f0-839e-adc901844267 tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-detach_volume" released by "detach_volume" :: held 0.192s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:23 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c" returned: 0 in 2.967s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72007f-6c84-4bfd-b2bb-455e1a24a900]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:23 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 2.010s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:23 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403
Apr 15 14:40:23 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:23 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:23 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:23 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d123499a-56dd-431f-9178-be27563b7403" returned: 0 in 0.541s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-d123499a-56dd-431f-9178-be27563b7403" released by "delete_volume" :: held 2.664s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:23 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.614s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:40:23 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Converted 1024.00 MB image at 344.98 MB/s
Apr 15 14:40:23 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c is being set with open permissions: ugo+rw
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:23 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['56f609d9-e659-4aba-94fb-4efe00a64413', '40798b47-bc78-4ab1-a0c6-ea5f6b8f9d93', '1ea1fada-2e1b-4df6-b452-56171c52db32', 'a3009c4f-5f08-4ca3-b4ef-4084137fc7fc'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:23 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c
Apr 15 14:40:23 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:24 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:24 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:24 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c" returned: 0 in 0.397s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-341a7c99-a81d-4baf-903e-5afe1937f63c" released by "_copy_volume_from_snapshot" :: held 5.237s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Deleting offline snapshot b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 of volume 97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] snapshot_file for this snap is: volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa728ab-3d3b-4389-9dc0-91becb8968a3]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:24 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:24 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6
Apr 15 14:40:24 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Deleted volume successfully.
Apr 15 14:40:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a07c54eb-5d4f-4d97-9a14-897f54c9db68 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-d123499a-56dd-431f-9178-be27563b7403-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:25 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ce9dae-acc7-492d-9eca-8dcc67e40765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (9f31f373-e6a6-4068-b485-190c29b6420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810537e3-5c13-4e27-88bd-fa182d5e6459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5652cb-ae4b-4fc3-b06a-28177cb6b665]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810537e3-5c13-4e27-88bd-fa182d5e6459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1751220272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:25Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20268e91-3b54-4161-ae7a-286a19fef652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20268e91-3b54-4161-ae7a-286a19fef652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b223b911-823e-4bb0-8689-13174171c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b223b911-823e-4bb0-8689-13174171c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01', 'volume_name': 'volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944e2604-68d0-465a-99ea-2a95609d7f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944e2604-68d0-465a-99ea-2a95609d7f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727ff8e3-4533-4a1d-90de-1d360d4fdb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Volume cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01', 'volume_size': 1}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:25 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:25 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:25 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:25 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6
Apr 15 14:40:25 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:26 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:26 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6
Apr 15 14:40:26 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:26 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765.b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-b43a9cba-840e-44d8-b156-c3eb7b4ec7f6" released by "_delete_snapshot" :: held 2.154s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.381s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.633s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-521694122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10702ffe-d91e-4fa7-826f-fd5968752e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df59b5059a5748cfb44bce15326a23e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:16Z,use_quota=True,user_id='24e8bf2d23e0467fb78a1c2dea122d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Creating volume 10702ffe-d91e-4fa7-826f-fd5968752e0d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002ec9cd-0190-4430-b3ee-494446e2d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341a7c99-a81d-4baf-903e-5afe1937f63c', 'volume_size': 1, 'source_volid': '97ce9dae-acc7-492d-9eca-8dcc67e40765', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19c5ee1-1b3f-42f9-98ec-d0c3c3abd95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:26 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d 1073741824
Apr 15 14:40:26 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Volume volume-341a7c99-a81d-4baf-903e-5afe1937f63c (341a7c99-a81d-4baf-903e-5afe1937f63c): created successfully
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19c5ee1-1b3f-42f9-98ec-d0c3c3abd95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Flow 'volume_create_manager' (168d4fb9-430b-4610-a21d-fcd7eeb48e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0e7a883c-b11f-4b65-ab40-07cb3f2a8229 tempest-VolumeDependencyTests-1676476263 None] Created volume successfully.
Apr 15 14:40:27 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d 1073741824" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:27 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d
Apr 15 14:40:27 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-97ce9dae-acc7-492d-9eca-8dcc67e40765-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-97ce9dae-acc7-492d-9eca-8dcc67e40765-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-97ce9dae-acc7-492d-9eca-8dcc67e40765" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-97ce9dae-acc7-492d-9eca-8dcc67e40765" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc5b94-a089-42cd-9285-2c4bd2fdebb0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:27 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:27 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:27 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1751220272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:25Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Creating volume cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:27 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f0b147-afa9-4532-a70b-45b823c16f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10702ffe-d91e-4fa7-826f-fd5968752e0d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:27 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 1073741824
Apr 15 14:40:27 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d98e531-a504-4f1b-b0a7-c98207e95d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Volume volume-10702ffe-d91e-4fa7-826f-fd5968752e0d (10702ffe-d91e-4fa7-826f-fd5968752e0d): created successfully
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d98e531-a504-4f1b-b0a7-c98207e95d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Flow 'volume_create_manager' (9274cbfc-8ae1-4989-813f-5125eb93c823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-55aca14a-e4b4-46f1-aa72-196ae682dc0b tempest-VolumesTransfersV357Test-1829997287 None] Created volume successfully.
Apr 15 14:40:28 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.513s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:28 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765
Apr 15 14:40:28 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:28 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 1073741824" returned: 0 in 0.531s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:28 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:28 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:28 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-97ce9dae-acc7-492d-9eca-8dcc67e40765" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-97ce9dae-acc7-492d-9eca-8dcc67e40765" released by "delete_volume" :: held 1.021s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Created reservations ['697ae065-d23d-499d-82e2-8bd71e3c574c', 'cb553757-b36e-41e7-85cd-12855b165f9e', '347fdc37-4191-40f4-b493-8d88e05de183', '11d54fcc-c6a3-4013-af65-99ecaddbb0cd'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:28 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:28 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:28 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727ff8e3-4533-4a1d-90de-1d360d4fdb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d282441b-d196-4d7a-9809-b751936d2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Volume volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 (cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01): created successfully
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d282441b-d196-4d7a-9809-b751936d2502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (9f31f373-e6a6-4068-b485-190c29b6420f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2b53e4a0-9815-4950-aeac-0aeeb1923387 tempest-VolumesSnapshotTestJSON-846651464 None] Created volume successfully.
Apr 15 14:40:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-986d9a47-15cb-4d42-90af-d55d0600ace3 tempest-VolumesTransfersV357Test-849272097 None] Transfer volume completed successfully.
Apr 15 14:40:29 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Deleted volume successfully.
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62a269ee-063e-48c8-bc82-3996dafecf21 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-97ce9dae-acc7-492d-9eca-8dcc67e40765-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Creating offline snapshot 6d65d54a-f477-4304-85a0-a0eb65cf5a84 of volume cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c45b726-97cd-42e6-86f8-026269ee7bc9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:29 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:29 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-341a7c99-a81d-4baf-903e-5afe1937f63c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-341a7c99-a81d-4baf-903e-5afe1937f63c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-341a7c99-a81d-4baf-903e-5afe1937f63c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-341a7c99-a81d-4baf-903e-5afe1937f63c" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a987165-05bc-4c76-8854-73dfde7a9c6f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Acquiring lock "cinder-10702ffe-d91e-4fa7-826f-fd5968752e0d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-10702ffe-d91e-4fa7-826f-fd5968752e0d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:29 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c
Apr 15 14:40:29 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Acquiring lock "cinder-quobyte-10702ffe-d91e-4fa7-826f-fd5968752e0d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-quobyte-10702ffe-d91e-4fa7-826f-fd5968752e0d" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4817dfdc-25e8-4bc7-8fbd-930c3fe93c9b]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:30 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.649s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:30 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d
Apr 15 14:40:30 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:30 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 1G
Apr 15 14:40:30 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:30 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c" returned: 0 in 0.650s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:30 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c
Apr 15 14:40:30 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:30 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d" returned: 0 in 0.635s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:30 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d
Apr 15 14:40:30 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:30 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 1G" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:30 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84
Apr 15 14:40:30 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:30 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-341a7c99-a81d-4baf-903e-5afe1937f63c" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-341a7c99-a81d-4baf-903e-5afe1937f63c" released by "delete_volume" :: held 1.185s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Created reservations ['0b3d9775-cc45-4c59-a0ed-0f8f160d8ac4', 'b3c975bb-366b-464c-8d3d-47254507491d', '29423e04-aca7-423d-8ada-009ce2f63073', 'c7cf633e-6081-4c81-9f69-e618517b9ae3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:31 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:31 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:31 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-10702ffe-d91e-4fa7-826f-fd5968752e0d" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-quobyte-10702ffe-d91e-4fa7-826f-fd5968752e0d" released by "delete_volume" :: held 1.182s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Created reservations ['69c3f6fc-dafe-42eb-a6ec-55ce496e0a22', '40ad67af-57d5-4a3b-a51e-e3ade660100d', 'dfd5ec2c-1a80-47af-a60a-c03c8804bad4', 'ce420d3f-5421-4c0c-a3d9-43388da9e121'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:31 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:31 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 is being set with open permissions: ugo+rw
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:31 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84
Apr 15 14:40:31 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:31 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:31 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:31 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Deleted volume successfully.
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7be34700-1174-4cf4-bd39-296e37097ea3 tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-341a7c99-a81d-4baf-903e-5afe1937f63c-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:31 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84" returned: 0 in 0.456s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:31 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.441s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:31 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info
Apr 15 14:40:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Deleted volume successfully.
Apr 15 14:40:31 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ce8b692d-b559-4c44-92b0-43e954e1b21c tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-10702ffe-d91e-4fa7-826f-fd5968752e0d-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-b9560a18-b5ac-4e67-920f-9e1ee885f864-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-b9560a18-b5ac-4e67-920f-9e1ee885f864-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "cinder-quobyte-b9560a18-b5ac-4e67-920f-9e1ee885f864" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-b9560a18-b5ac-4e67-920f-9e1ee885f864" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbed0a6-1dc5-47b2-a31a-08ec68f552fa]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:32 devstack sudo[89329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864
Apr 15 14:40:32 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:32 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:32 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info is being set with open permissions: ugo+rw
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:32 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info
Apr 15 14:40:32 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Flow 'volume_create_manager' (4c959649-0e6d-4c26-b838-00eb1072631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1eb28d-1cae-4427-93c1-fce6f2963fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1eb28d-1cae-4427-93c1-fce6f2963fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-66363168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc6c9f4-4699-458a-b03d-05062353b82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df59b5059a5748cfb44bce15326a23e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:32Z,use_quota=True,user_id='24e8bf2d23e0467fb78a1c2dea122d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b401c1d0-2059-408a-81bd-c3f4a0d64c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b401c1d0-2059-408a-81bd-c3f4a0d64c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3676c9f0-87f0-4e30-819f-6f159b3126ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3676c9f0-87f0-4e30-819f-6f159b3126ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc6c9f4-4699-458a-b03d-05062353b82d', 'volume_name': 'volume-2bc6c9f4-4699-458a-b03d-05062353b82d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6fd88d-cbe5-4ef7-a6dc-022cab932437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6fd88d-cbe5-4ef7-a6dc-022cab932437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb69b37c-7a5e-489c-a6ab-f4b0ea30095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Volume 2bc6c9f4-4699-458a-b03d-05062353b82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc6c9f4-4699-458a-b03d-05062353b82d', 'volume_size': 1}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:32 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.info" returned: 0 in 0.450s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:32 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-66363168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc6c9f4-4699-458a-b03d-05062353b82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df59b5059a5748cfb44bce15326a23e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:32Z,use_quota=True,user_id='24e8bf2d23e0467fb78a1c2dea122d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Creating volume 2bc6c9f4-4699-458a-b03d-05062353b82d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:32 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:32 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d 1073741824
Apr 15 14:40:32 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-16b6d88a-9587-4486-8f85-caba95919f6e tempest-VolumesSnapshotTestJSON-846651464 None] Create snapshot completed successfully
Apr 15 14:40:32 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864
Apr 15 14:40:32 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:33 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b9560a18-b5ac-4e67-920f-9e1ee885f864" returned: 0 in 0.474s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-quobyte-b9560a18-b5ac-4e67-920f-9e1ee885f864" released by "delete_volume" :: held 1.140s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:33 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Created reservations ['329e77e2-1930-4b23-bf7c-b9308ade5c5c', 'bfc6ce19-5ab9-4c3c-9873-54cc8b1887ac', '21d7e904-7142-4c10-87fc-4d9426bda0cb', '996d58aa-22c1-42d6-9c26-66ccdd0bde64'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d 1073741824" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:33 devstack sudo[89346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:33 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:33 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:33 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:33 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d" returned: 0 in 0.430s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb69b37c-7a5e-489c-a6ab-f4b0ea30095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc6c9f4-4699-458a-b03d-05062353b82d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb62ab0-7dbd-4713-8ea8-240c483034ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Volume volume-2bc6c9f4-4699-458a-b03d-05062353b82d (2bc6c9f4-4699-458a-b03d-05062353b82d): created successfully
Apr 15 14:40:33 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb62ab0-7dbd-4713-8ea8-240c483034ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Flow 'volume_create_manager' (4c959649-0e6d-4c26-b838-00eb1072631a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Deleted volume successfully.
Apr 15 14:40:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-21d6de48-d9d1-4176-89e1-88cd29097fe4 tempest-VolumesTransfersV357Test-1829997287 None] Created volume successfully.
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34805b23-51cb-4538-8e77-2debb333208c tempest-VolumeDependencyTests-1676476263 None] Lock "cinder-b9560a18-b5ac-4e67-920f-9e1ee885f864-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (a4f17456-f8e7-43c8-acb3-e7467adce56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4735b204-37db-4116-9334-11e308075128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4735b204-37db-4116-9334-11e308075128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-980839615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a107f-d1a1-44fc-8fe0-90c601ca0ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ffd81f5542f429491de67192cb2dbd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d65d54a-f477-4304-85a0-a0eb65cf5a84,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:34Z,use_quota=True,user_id='01f20636c52a469e893c0c4320e92735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02e0ece-9165-4ec2-ba62-82af01283cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02e0ece-9165-4ec2-ba62-82af01283cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a45629-f5a4-4c32-8288-ee6bb8bd4fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a45629-f5a4-4c32-8288-ee6bb8bd4fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '610a107f-d1a1-44fc-8fe0-90c601ca0ab5', 'volume_name': 'volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5', 'volume_size': 1, 'snapshot_id': '6d65d54a-f477-4304-85a0-a0eb65cf5a84'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0cab04-dc88-4815-996c-26ac179dde38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0cab04-dc88-4815-996c-26ac179dde38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07f8258-8e5d-4ccf-9704-2f70e6e6ab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Volume 610a107f-d1a1-44fc-8fe0-90c601ca0ab5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5', 'volume_size': 1, 'snapshot_id': '6d65d54a-f477-4304-85a0-a0eb65cf5a84'}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-6d65d54a-f477-4304-85a0-a0eb65cf5a84-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-6d65d54a-f477-4304-85a0-a0eb65cf5a84-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Creating volume 610a107f-d1a1-44fc-8fe0-90c601ca0ab5 from snapshot 6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] snapshot: 6d65d54a-f477-4304-85a0-a0eb65cf5a84, volume: 610a107f-d1a1-44fc-8fe0-90c601ca0ab5,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca03d95-a3b1-4b28-8084-f2f4094d00a4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:33 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84
Apr 15 14:40:33 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:34 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7658e70b-1c84-40d0-95b6-7686928263b9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:34 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:34 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Acquiring lock "cinder-2bc6c9f4-4699-458a-b03d-05062353b82d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-2bc6c9f4-4699-458a-b03d-05062353b82d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Acquiring lock "cinder-quobyte-2bc6c9f4-4699-458a-b03d-05062353b82d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-quobyte-2bc6c9f4-4699-458a-b03d-05062353b82d" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8430b4-3dbc-4f8c-ab6c-d229377e2069]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:34 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d
Apr 15 14:40:34 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:35 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.689s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:35 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:40:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:35 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5
Apr 15 14:40:35 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:35 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:35 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d
Apr 15 14:40:35 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:36 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2bc6c9f4-4699-458a-b03d-05062353b82d" returned: 0 in 0.958s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-quobyte-2bc6c9f4-4699-458a-b03d-05062353b82d" released by "delete_volume" :: held 1.563s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Created reservations ['e330045c-88d4-497e-ab78-4407ed475028', '863cf8ab-cb85-4f6a-8b50-aa5e15cb894f', 'ec541f14-6ea4-4db7-9a10-7f2c0511fac3', 'b4652fcc-f28a-4aac-a019-58c50ee34b65'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:36 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:36 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:37 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" returned: 0 in 2.444s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a3e803-6770-4124-b80e-bf365c6c21f8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:37 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:37 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:37 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.316s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:37 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Deleted volume successfully.
Apr 15 14:40:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d0db4861-feb1-4c50-8bbb-99588d9841d2 tempest-VolumesTransfersV357Test-542669603 None] Lock "cinder-2bc6c9f4-4699-458a-b03d-05062353b82d-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:38 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.672s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:40:38 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Converted 1024.00 MB image at 418.59 MB/s
Apr 15 14:40:38 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 is being set with open permissions: ugo+rw
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:38 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5
Apr 15 14:40:38 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:38 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" released by "_copy_volume_from_snapshot" :: held 4.925s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-6d65d54a-f477-4304-85a0-a0eb65cf5a84-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" released by "_create_volume_from_snapshot" :: held 4.940s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.947s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07f8258-8e5d-4ccf-9704-2f70e6e6ab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5', 'volume_size': 1, 'snapshot_id': '6d65d54a-f477-4304-85a0-a0eb65cf5a84'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177dd4fe-73d5-491c-82ec-ad43a7ccebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Volume volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 (610a107f-d1a1-44fc-8fe0-90c601ca0ab5): created successfully
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177dd4fe-73d5-491c-82ec-ad43a7ccebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Flow 'volume_create_manager' (a4f17456-f8e7-43c8-acb3-e7467adce56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9dfa0a46-f9bf-4d28-9945-0d9d20f15ba7 tempest-VolumesSnapshotTestJSON-846651464 None] Created volume successfully.
Apr 15 14:40:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-610a107f-d1a1-44fc-8fe0-90c601ca0ab5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-610a107f-d1a1-44fc-8fe0-90c601ca0ab5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[717206e8-a090-4628-8875-b4460c3bc199]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:39 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5
Apr 15 14:40:39 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:40 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" returned: 0 in 0.641s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:40 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5
Apr 15 14:40:40 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:40 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-610a107f-d1a1-44fc-8fe0-90c601ca0ab5" released by "delete_volume" :: held 1.177s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=202,cinder:SELECT=172,cinder:INSERT=51,cinder:DELETE=17 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['437d44e5-0548-4fc4-8edd-9cfc9a7b0215', '423b729e-8db3-417c-8c5b-8834bef35fbe', '0a8aadb1-102c-47ae-90f7-d175609beeec', '464c5069-5017-4ba7-ab9e-2b91828c8a71'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:40 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:40 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Flow 'volume_create_manager' (cbf1fa4f-d2bc-4a69-ae0e-0ecd1fc0b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df67f946-2480-4e81-b894-7ebde529c735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df67f946-2480-4e81-b894-7ebde529c735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1066165954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775f7d47-0242-4198-8824-733bf129bd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d678cf76273f4c3892f09775ba87f16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:41Z,use_quota=True,user_id='07e7cec5ee784e3b878e3bec85247ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9b0a5b-baa6-4dd5-8c9a-25d4a5fe0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9b0a5b-baa6-4dd5-8c9a-25d4a5fe0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11943d52-c5c5-4646-a0d5-f8f31e859195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11943d52-c5c5-4646-a0d5-f8f31e859195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775f7d47-0242-4198-8824-733bf129bd3e', 'volume_name': 'volume-775f7d47-0242-4198-8824-733bf129bd3e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7516a3b-9c79-4671-92eb-5365c77a8634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7516a3b-9c79-4671-92eb-5365c77a8634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae3af18-d5cf-447a-8ee3-2eb72f264653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Volume 775f7d47-0242-4198-8824-733bf129bd3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775f7d47-0242-4198-8824-733bf129bd3e', 'volume_size': 1}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1066165954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775f7d47-0242-4198-8824-733bf129bd3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d678cf76273f4c3892f09775ba87f16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:40:41Z,use_quota=True,user_id='07e7cec5ee784e3b878e3bec85247ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Creating volume 775f7d47-0242-4198-8824-733bf129bd3e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:40:41 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:41 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e 1073741824
Apr 15 14:40:41 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:41 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.458s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Deleted volume successfully.
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3b7da86a-04e4-476d-b4fa-bae36794ab87 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-610a107f-d1a1-44fc-8fe0-90c601ca0ab5-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:41 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e 1073741824" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-6d65d54a-f477-4304-85a0-a0eb65cf5a84-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-6d65d54a-f477-4304-85a0-a0eb65cf5a84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:41 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e
Apr 15 14:40:41 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-6d65d54a-f477-4304-85a0-a0eb65cf5a84" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-6d65d54a-f477-4304-85a0-a0eb65cf5a84" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Deleting offline snapshot 6d65d54a-f477-4304-85a0-a0eb65cf5a84 of volume cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] snapshot_file for this snap is: volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db72480-e0ee-4935-9c80-ad5eed945d93]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:41 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84
Apr 15 14:40:41 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:41 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e" returned: 0 in 0.423s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae3af18-d5cf-447a-8ee3-2eb72f264653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775f7d47-0242-4198-8824-733bf129bd3e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509ea44b-e671-467b-8561-bfaa48a1bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:40:42 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Volume volume-775f7d47-0242-4198-8824-733bf129bd3e (775f7d47-0242-4198-8824-733bf129bd3e): created successfully
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509ea44b-e671-467b-8561-bfaa48a1bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Flow 'volume_create_manager' (cbf1fa4f-d2bc-4a69-ae0e-0ecd1fc0b342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:40:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d85d64a5-b756-46b6-934c-a3ed94bc9d5b tempest-VolumesNegativeTest-958690472 None] Created volume successfully.
Apr 15 14:40:42 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ce87d-fd3d-4be0-8388-0e2a33b08f02]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:42 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:42 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:42 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.608s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:42 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84
Apr 15 14:40:42 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:43 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84" returned: 0 in 0.690s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:43 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84
Apr 15 14:40:43 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:43 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01.6d65d54a-f477-4304-85a0-a0eb65cf5a84" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:43 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=229,cinder:SELECT=181,cinder:DELETE=20,cinder:INSERT=52 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:40:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-6d65d54a-f477-4304-85a0-a0eb65cf5a84" released by "_delete_snapshot" :: held 2.375s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" released by "delete_snapshot" :: held 2.385s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['66348de1-7535-4769-a6cd-0503d62b7d46', 'fe133490-28d3-4397-8f58-f79aa5f94608', 'befdaa3d-b2f9-4bdd-bbcd-364706572c0d', 'ba79f30c-108b-4d15-8d15-768e27649f3b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Delete snapshot completed successfully.
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-46f02119-bc40-4273-8920-b5ee4191deb2 tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-6d65d54a-f477-4304-85a0-a0eb65cf5a84-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" acquired by "delete_volume" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[98048883-3d34-403d-b6dd-436bff22a330]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:45 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:45 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1efc6fc4-cacc-485a-9e58-4fa8177bde7e tempest-VolumesActionsTest-292559922 None] Acquiring lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29" by "attach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1efc6fc4-cacc-485a-9e58-4fa8177bde7e tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29" acquired by "attach_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1efc6fc4-cacc-485a-9e58-4fa8177bde7e tempest-VolumesActionsTest-292559922 None] Attaching volume 679c0198-5e14-4bfc-b663-32c98eb29f29 to instance 89056f13-c946-4b05-9045-d28ab75b7f1a at mountpoint /dev/vdb on host None.
Apr 15 14:40:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1efc6fc4-cacc-485a-9e58-4fa8177bde7e tempest-VolumesActionsTest-292559922 None] Attach volume completed successfully.
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1efc6fc4-cacc-485a-9e58-4fa8177bde7e tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29" released by "attach_volume" :: held 0.057s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:45 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:45 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01
Apr 15 14:40:45 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:45 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-94e37ab6-eff9-49cd-bc14-0364af61a743 tempest-VolumesActionsTest-292559922 None] Acquiring lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01" released by "delete_volume" :: held 1.034s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-94e37ab6-eff9-49cd-bc14-0364af61a743 tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-94e37ab6-eff9-49cd-bc14-0364af61a743 tempest-VolumesActionsTest-292559922 None] Detaching volume 679c0198-5e14-4bfc-b663-32c98eb29f29 from instance 89056f13-c946-4b05-9045-d28ab75b7f1a.
Apr 15 14:40:45 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['25ed6f35-cf31-4cca-bfa5-490800622f87', 'b0678fa8-9988-4299-9243-93ec0138492c', '2e4d88ec-821b-4741-8e95-afe71999a5bd', '18cdd440-6d69-40c0-b797-1f40b6a01bd2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-94e37ab6-eff9-49cd-bc14-0364af61a743 tempest-VolumesActionsTest-292559922 None] Detach volume completed successfully.
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-94e37ab6-eff9-49cd-bc14-0364af61a743 tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:46 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:46 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:46 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Deleted volume successfully.
Apr 15 14:40:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-35f9343f-cafa-4769-8999-1691a756a71b tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-cb4e0fda-2304-4a2c-b2f5-d2f5d525bb01-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-efbf394b-91bb-4eba-b80c-713c6dfe70b5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-efbf394b-91bb-4eba-b80c-713c6dfe70b5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "cinder-quobyte-efbf394b-91bb-4eba-b80c-713c6dfe70b5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-efbf394b-91bb-4eba-b80c-713c6dfe70b5" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[038699d0-50d0-4aaf-ae36-c5bb8df08fb5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:47 devstack sudo[89534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5
Apr 15 14:40:47 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:47 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:47 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:47 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:47 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5
Apr 15 14:40:47 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:48 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.603s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:48 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-efbf394b-91bb-4eba-b80c-713c6dfe70b5" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-quobyte-efbf394b-91bb-4eba-b80c-713c6dfe70b5" released by "delete_volume" :: held 1.145s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Created reservations ['42f11a93-26cd-48dc-ac38-8c3da99cc547', '832e1ae7-4c98-40d1-9958-9031bf9d3590', '3654a386-f66e-4f96-a1a1-4ff32c432e22', '6d5d5ef8-1921-45f9-89f4-71ce2ecf2d46'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:48 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:40:48 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:48 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:40:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Deleted volume successfully.
Apr 15 14:40:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0acbccbf-e16e-4654-bc6c-18f84939902e tempest-VolumesSnapshotTestJSON-846651464 None] Lock "cinder-efbf394b-91bb-4eba-b80c-713c6dfe70b5-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:40:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[61625dd3-f93f-4e4f-8b2d-be59d1d7c3f2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:54 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:40:54 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:55 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d365210b-d63b-4aae-830b-419c078c3287]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:55 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:40:55 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:55 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.551s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.9c8d3e22-da57-4aab-b289-fc6119363ce07zlr1rsm.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:55 devstack sudo[89640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.9c8d3e22-da57-4aab-b289-fc6119363ce07zlr1rsm.img
Apr 15 14:40:55 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:58 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.9c8d3e22-da57-4aab-b289-fc6119363ce07zlr1rsm.img" returned: 0 in 2.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2500fa-0086-47c1-992b-ef38f5f17a1e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:40:58 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:40:58 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:40:58 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:40:58 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 15 14:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.640s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:40:59 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.9c8d3e22-da57-4aab-b289-fc6119363ce07zlr1rsm.img {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:40:59 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Converted 1024.00 MB image at 420.65 MB/s
Apr 15 14:40:59 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] 9c8d3e22-da57-4aab-b289-fc6119363ce0 was raw, no need to convert to raw {{(pid=83037) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Acquiring lock "cinder-775f7d47-0242-4198-8824-733bf129bd3e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Lock "cinder-775f7d47-0242-4198-8824-733bf129bd3e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Acquiring lock "cinder-quobyte-775f7d47-0242-4198-8824-733bf129bd3e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Lock "cinder-quobyte-775f7d47-0242-4198-8824-733bf129bd3e" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb6bec-50b1-4374-b9ba-48108d308dca]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:08 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e
Apr 15 14:41:08 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:08 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:08 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e
Apr 15 14:41:08 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:09 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.455s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Uploaded volume to glance image-id: 9c8d3e22-da57-4aab-b289-fc6119363ce0. {{(pid=83037) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-775f7d47-0242-4198-8824-733bf129bd3e" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Lock "cinder-quobyte-775f7d47-0242-4198-8824-733bf129bd3e" released by "delete_volume" :: held 1.151s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-453ad47d-7921-4852-a05b-9a70a27dbb25 tempest-VolumesActionsTest-292559922 None] Copy volume to image completed successfully.
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Created reservations ['86c92702-598a-46d4-a224-849636ab72ea', '8637fd55-7537-4c35-a71a-d630d08183e0', '1dab876b-0804-42d2-81f4-030ffbe388cf', 'ec28c1fc-6748-4326-8ed3-a2f87a340418'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:09 devstack sudo[89699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:09 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:09 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.421s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Deleted volume successfully.
Apr 15 14:41:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ac849d55-bed1-411d-934e-65405c95d598 tempest-VolumesNegativeTest-958690472 None] Lock "cinder-775f7d47-0242-4198-8824-733bf129bd3e-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e9c314-7184-467e-981e-bf79c34d0bb4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:10 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:41:10 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:10 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.555s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6dfe66-b2fc-4f47-a90f-55e3095d4222]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:10 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:41:10 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:11 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.503s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:11 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img
Apr 15 14:41:11 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Flow 'volume_create_manager' (3a80f904-0c08-49b7-8459-035413ee260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2141a4-445f-44eb-932e-134e4b27828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2141a4-445f-44eb-932e-134e4b27828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-744833244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b56f910-9c56-40a1-a44a-29584b6428d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e9cb6b27f145c8b738e6688d8bd2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:12Z,use_quota=True,user_id='40fbd7a4c0ea4e218fbb8170606dcb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad82f2b-7bfc-424c-a77c-3febb2066da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad82f2b-7bfc-424c-a77c-3febb2066da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29fa770-aaeb-41d6-be1f-ad9b4aa6db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29fa770-aaeb-41d6-be1f-ad9b4aa6db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b56f910-9c56-40a1-a44a-29584b6428d4', 'volume_name': 'volume-5b56f910-9c56-40a1-a44a-29584b6428d4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccfc730-56ef-4261-839a-b7a3cd8a4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccfc730-56ef-4261-839a-b7a3cd8a4626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a42a80-32c3-4bc1-908f-9af0a895bf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Volume 5b56f910-9c56-40a1-a44a-29584b6428d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b56f910-9c56-40a1-a44a-29584b6428d4', 'volume_size': 1}
Apr 15 14:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:13 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img" returned: 0 in 1.919s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f0b58-d61f-40d4-abc8-702f18d519ca]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:13 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:41:13 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:13 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:13 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:41:13 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Converted 1024.00 MB image at 533.33 MB/s
Apr 15 14:41:13 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] ce0c6918-8cd9-45a1-904e-92e3187d0c4c was raw, converting to qcow2 {{(pid=83037) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee91d5f-1683-44bf-b667-1a07ee91ff17]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:14 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img
Apr 15 14:41:14 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:14 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:14 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img
Apr 15 14:41:14 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:14 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img" returned: 1 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:14 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a
Apr 15 14:41:14 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:15 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a" returned: 0 in 0.419s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:15 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Image conversion details: src /opt/stack/data/cinder/conversion/679c0198-5e14-4bfc-b663-32c98eb29f29.temp_image.ce0c6918-8cd9-45a1-904e-92e3187d0c4c2954r48r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:41:15 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 15 14:41:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b77b2-2f14-44e6-bd8c-773f32c41eb5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:15 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a
Apr 15 14:41:15 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:15 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a2n9r43a" returned: 0 in 0.482s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.384s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Uploaded volume to glance image-id: ce0c6918-8cd9-45a1-904e-92e3187d0c4c. {{(pid=83037) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.508s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-744833244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b56f910-9c56-40a1-a44a-29584b6428d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e9cb6b27f145c8b738e6688d8bd2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:12Z,use_quota=True,user_id='40fbd7a4c0ea4e218fbb8170606dcb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Creating volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:41:16 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:16 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 1073741824
Apr 15 14:41:16 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6da6d90e-b107-4962-bacb-36f8bb9578a3 tempest-VolumesActionsTest-292559922 None] Copy volume to image completed successfully.
Apr 15 14:41:17 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 1073741824" returned: 0 in 0.487s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:17 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4
Apr 15 14:41:17 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:17 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4" returned: 0 in 0.434s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a42a80-32c3-4bc1-908f-9af0a895bf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b56f910-9c56-40a1-a44a-29584b6428d4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94801594-89f5-47ee-98fa-08fffc63bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Volume volume-5b56f910-9c56-40a1-a44a-29584b6428d4 (5b56f910-9c56-40a1-a44a-29584b6428d4): created successfully
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94801594-89f5-47ee-98fa-08fffc63bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Flow 'volume_create_manager' (3a80f904-0c08-49b7-8459-035413ee260a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a67100b8-3a7b-4ba1-aa09-80b164c33071 tempest-VolumesSnapshotListTestJSON-1097566630 None] Created volume successfully.
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Acquiring lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Acquiring lock "cinder-quobyte-679c0198-5e14-4bfc-b663-32c98eb29f29" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Lock "cinder-quobyte-679c0198-5e14-4bfc-b663-32c98eb29f29" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dae2d73-a1eb-4d76-958c-df6c333c1535]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:17 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:41:17 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Creating offline snapshot 5c4c05c0-5776-40cf-a306-ac47f7b9bf48 of volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a752551-142e-4bc6-a25c-ec25c686f5df]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:18 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4
Apr 15 14:41:18 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:18 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.490s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:18 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29
Apr 15 14:41:18 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:18 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4" returned: 0 in 0.473s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:18 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 1G
Apr 15 14:41:18 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:18 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-679c0198-5e14-4bfc-b663-32c98eb29f29" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Lock "cinder-quobyte-679c0198-5e14-4bfc-b663-32c98eb29f29" released by "delete_volume" :: held 0.927s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Created reservations ['d7bed937-0ea5-4571-a27a-0e1aa80aa606', 'f2f11b41-d939-4a47-a7f8-aea8f929547a', '142e44fa-f019-4d0e-a2a9-04a6740fff17', '28455f3d-f07c-4b8b-a994-bf025dbe4356'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:18 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:18 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:19 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.412s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:19 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Deleted volume successfully.
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 1G" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b54fa591-b746-45bc-ba74-6f2d0642e51c tempest-VolumesActionsTest-292559922 None] Lock "cinder-679c0198-5e14-4bfc-b663-32c98eb29f29-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:19 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:19 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:19 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.504s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:19 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 is being set with open permissions: ugo+rw
Apr 15 14:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:19 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:19 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:20 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.453s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:20 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info
Apr 15 14:41:20 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:20 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info" returned: 0 in 0.467s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:20 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info is being set with open permissions: ugo+rw
Apr 15 14:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:20 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info
Apr 15 14:41:20 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:21 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.info" returned: 0 in 0.441s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-231bd2ec-821c-4c96-91be-3dc840ca875b tempest-VolumesSnapshotListTestJSON-1097566630 None] Create snapshot completed successfully
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Creating offline snapshot 80933e06-cd2d-47a6-b68e-ea2600c9ae6b of volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f02cffb-3e6a-4f11-9e45-c28c6f6d81b1]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:21 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:21 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:22 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:22 devstack sudo[89799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b 1G
Apr 15 14:41:22 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:22 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b 1G" returned: 0 in 0.561s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:22 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:22 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Flow 'volume_create_manager' (9010dd91-93d0-4f54-8721-01caccb15f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b60283f-60cd-40e3-b557-d138b6a843b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b60283f-60cd-40e3-b557-d138b6a843b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-656678756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e64902-2490-4556-a992-537a4dfe00a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c12b2ccd6d4fecb9c9aac96710fb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:23Z,use_quota=True,user_id='8b5f7abb64a84d43ace4b1e33fc9476e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac28b27-e8bb-4f2f-b649-1bfa68b7242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac28b27-e8bb-4f2f-b649-1bfa68b7242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871cf8c2-5dc4-4825-8c8f-05b81a274396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871cf8c2-5dc4-4825-8c8f-05b81a274396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e64902-2490-4556-a992-537a4dfe00a3', 'volume_name': 'volume-62e64902-2490-4556-a992-537a4dfe00a3', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e94e674-a1df-4452-9dda-75de1417fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e94e674-a1df-4452-9dda-75de1417fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ad4a3-efdf-4ecc-b59c-bb177d22e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Volume 62e64902-2490-4556-a992-537a4dfe00a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e64902-2490-4556-a992-537a4dfe00a3', 'volume_size': 1}
Apr 15 14:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:23 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:23 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b is being set with open permissions: ugo+rw
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:23 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:23 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:23 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 0.390s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-656678756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e64902-2490-4556-a992-537a4dfe00a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c12b2ccd6d4fecb9c9aac96710fb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:23Z,use_quota=True,user_id='8b5f7abb64a84d43ace4b1e33fc9476e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Creating volume 62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:41:23 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c97fa4d6-c978-4bb5-a66b-ef9997fdcc9c tempest-VolumesSnapshotListTestJSON-1097566630 None] Create snapshot completed successfully
Apr 15 14:41:23 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 1073741824
Apr 15 14:41:23 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:24 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 1073741824" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:24 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:24 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:24 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.391s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ad4a3-efdf-4ecc-b59c-bb177d22e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e64902-2490-4556-a992-537a4dfe00a3', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b41297a-74c5-4728-912d-35aa2478641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:24 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Volume volume-62e64902-2490-4556-a992-537a4dfe00a3 (62e64902-2490-4556-a992-537a4dfe00a3): created successfully
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b41297a-74c5-4728-912d-35aa2478641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Flow 'volume_create_manager' (9010dd91-93d0-4f54-8721-01caccb15f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b6b26379-6aae-4d54-b430-ad33996cb00c tempest-VolumesCloneTest-1687442596 None] Created volume successfully.
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Creating offline snapshot df56d831-74fb-4833-a1b9-4bdf48bdfff5 of volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d8de8-eb24-4948-b000-c8d919b47bc4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:24 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:24 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Flow 'volume_create_manager' (4753a4d6-9378-46ec-83a5-18897943c7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec90172f-223a-4d0f-b947-282127e6b65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec90172f-223a-4d0f-b947-282127e6b65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-39562765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905aafea-3841-4ca0-8c99-1e4319d7da9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c12b2ccd6d4fecb9c9aac96710fb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=62e64902-2490-4556-a992-537a4dfe00a3,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:25Z,use_quota=True,user_id='8b5f7abb64a84d43ace4b1e33fc9476e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23a6b3-ac9f-46b3-b406-217fff5cf15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23a6b3-ac9f-46b3-b406-217fff5cf15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe238fbe-3d96-4a17-83ce-d0ddfda30281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe238fbe-3d96-4a17-83ce-d0ddfda30281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '905aafea-3841-4ca0-8c99-1e4319d7da9c', 'volume_name': 'volume-905aafea-3841-4ca0-8c99-1e4319d7da9c', 'volume_size': 2, 'source_volid': '62e64902-2490-4556-a992-537a4dfe00a3', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28096ca3-62b6-4d99-a03c-f40a2a356246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28096ca3-62b6-4d99-a03c-f40a2a356246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69700206-f1ec-4661-a734-0c25c746a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Volume 905aafea-3841-4ca0-8c99-1e4319d7da9c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-905aafea-3841-4ca0-8c99-1e4319d7da9c', 'volume_size': 2, 'source_volid': '62e64902-2490-4556-a992-537a4dfe00a3', 'source_volstatus': 'available'}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:25 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:25 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 1G
Apr 15 14:41:25 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:25 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 1G" returned: 0 in 0.483s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:25 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5
Apr 15 14:41:25 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:26 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:26 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 is being set with open permissions: ugo+rw
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:26 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5
Apr 15 14:41:26 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:26 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5" returned: 0 in 0.389s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.410s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Cloning volume 62e64902-2490-4556-a992-537a4dfe00a3 to volume 905aafea-3841-4ca0-8c99-1e4319d7da9c
Apr 15 14:41:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c0110b78-7081-4ea6-b208-48704ac24a64 tempest-VolumesSnapshotListTestJSON-1097566630 None] Create snapshot completed successfully
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Creating offline snapshot 7c83f5fd-5b25-4917-b57f-962569dc51da of volume 62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f6fc0d-af79-43c1-96fb-adb5d482f449]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:26 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:26 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:27 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.483s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:27 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da 1G
Apr 15 14:41:27 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-df56d831-74fb-4833-a1b9-4bdf48bdfff5-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-df56d831-74fb-4833-a1b9-4bdf48bdfff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-df56d831-74fb-4833-a1b9-4bdf48bdfff5" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-df56d831-74fb-4833-a1b9-4bdf48bdfff5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Deleting offline snapshot df56d831-74fb-4833-a1b9-4bdf48bdfff5 of volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] snapshot_file for this snap is: volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a81230-7991-43b5-947d-456556a6886e]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:27 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5
Apr 15 14:41:27 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:27 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da 1G" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62e64902-2490-4556-a992-537a4dfe00a3 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:27 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62e64902-2490-4556-a992-537a4dfe00a3 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da
Apr 15 14:41:27 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:27 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5" returned: 0 in 0.482s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc976983-df69-4aa6-8fea-006fad8c0a08]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:27 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:27 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:28 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62e64902-2490-4556-a992-537a4dfe00a3 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da" returned: 0 in 0.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:28 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da is being set with open permissions: ugo+rw
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:28 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da
Apr 15 14:41:28 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:28 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:28 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5
Apr 15 14:41:28 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:28 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da" returned: 0 in 0.406s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:28 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info
Apr 15 14:41:28 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:28 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info" returned: 0 in 0.427s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:28 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info is being set with open permissions: ugo+rw
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:28 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:28 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info
Apr 15 14:41:28 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:28 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5
Apr 15 14:41:28 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:29 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.info" returned: 0 in 0.436s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:29 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Acquiring lock "cinder-quobyte-905aafea-3841-4ca0-8c99-1e4319d7da9c" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.df56d831-74fb-4833-a1b9-4bdf48bdfff5" returned: 0 in 0.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-df56d831-74fb-4833-a1b9-4bdf48bdfff5" released by "_delete_snapshot" :: held 1.934s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-905aafea-3841-4ca0-8c99-1e4319d7da9c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] snapshot: 7c83f5fd-5b25-4917-b57f-962569dc51da, volume: 905aafea-3841-4ca0-8c99-1e4319d7da9c,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" released by "delete_snapshot" :: held 1.957s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbd835-3ff6-4efa-933a-1554aa1936c8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Created reservations ['5fecc934-b31d-4235-b93b-547a67e708d4', '8288597e-acff-4b05-89cc-11b31ce3c138', '237e5412-4c82-4b7f-851a-ab11da914fff', 'cb83c1ac-1fa6-40f3-855b-e4e4edda8cd8'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:29 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da
Apr 15 14:41:29 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Delete snapshot completed successfully.
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75068cca-02c3-4a9d-a427-28094789662f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-df56d831-74fb-4833-a1b9-4bdf48bdfff5-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-80933e06-cd2d-47a6-b68e-ea2600c9ae6b-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-80933e06-cd2d-47a6-b68e-ea2600c9ae6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-80933e06-cd2d-47a6-b68e-ea2600c9ae6b" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-80933e06-cd2d-47a6-b68e-ea2600c9ae6b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Deleting offline snapshot 80933e06-cd2d-47a6-b68e-ea2600c9ae6b of volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] snapshot_file for this snap is: volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6003fa9a-6e83-4ac5-b948-53b9dfe9c9e9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:29 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:29 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:29 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62e64902-2490-4556-a992-537a4dfe00a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b587e8-3c8e-4a25-88e3-7814750fcf19]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:29 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:29 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:30 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 0.480s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab73d313-b421-44af-a1b8-b9dab807ba42]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:30 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:30 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:30 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:30 devstack sudo[89900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c
Apr 15 14:41:30 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:30 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:30 devstack sudo[89905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:30 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:31 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 0.802s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:31 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b
Apr 15 14:41:31 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:32 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.80933e06-cd2d-47a6-b68e-ea2600c9ae6b" returned: 0 in 1.022s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:32 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-80933e06-cd2d-47a6-b68e-ea2600c9ae6b" released by "_delete_snapshot" :: held 2.822s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c" returned: 0 in 2.016s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" released by "delete_snapshot" :: held 2.836s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d8aa2-8e3f-4b1b-9dd4-dff3fd5e6866]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Created reservations ['cfb98d2b-aed0-4f32-8294-f9c74a10b662', 'fe6e9ca3-0065-44c1-b6ba-93480b4d55b8', '0e7eb88f-8da7-42c3-b7ea-1eeee04a5c9d', 'f46f836f-f3db-49ac-9069-8da531943818'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:32 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:32 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Delete snapshot completed successfully.
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-619d0060-28cd-41b9-80cf-cbadcfe8cf9b tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-80933e06-cd2d-47a6-b68e-ea2600c9ae6b-delete_snapshot" released by "delete_snapshot" :: held 2.949s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-5c4c05c0-5776-40cf-a306-ac47f7b9bf48-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-5c4c05c0-5776-40cf-a306-ac47f7b9bf48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-5c4c05c0-5776-40cf-a306-ac47f7b9bf48" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5c4c05c0-5776-40cf-a306-ac47f7b9bf48" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Deleting offline snapshot 5c4c05c0-5776-40cf-a306-ac47f7b9bf48 of volume 5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] snapshot_file for this snap is: volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a7f419-e292-41da-9303-378b537ef1ce]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:32 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:32 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:32 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.638s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:41:32 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Converted 1024.00 MB image at 507.06 MB/s
Apr 15 14:41:32 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c is being set with open permissions: ugo+rw
Apr 15 14:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:33 devstack sudo[89930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c
Apr 15 14:41:33 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:33 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.499s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b56f910-9c56-40a1-a44a-29584b6428d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[988b6527-de5c-42ca-b25f-97c68f4fa862]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:33 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4
Apr 15 14:41:33 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:33 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c" returned: 0 in 0.412s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-905aafea-3841-4ca0-8c99-1e4319d7da9c" released by "_copy_volume_from_snapshot" :: held 4.087s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Acquiring lock "cinder-quobyte-7c83f5fd-5b25-4917-b57f-962569dc51da" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-7c83f5fd-5b25-4917-b57f-962569dc51da" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Deleting offline snapshot 7c83f5fd-5b25-4917-b57f-962569dc51da of volume 62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] snapshot_file for this snap is: volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c27fdb9-f915-49a9-977c-56837a534f61]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:33 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da
Apr 15 14:41:33 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:33 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:33 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:33 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:33 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62e64902-2490-4556-a992-537a4dfe00a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e364266-ba07-42f9-9935-36e379c695e2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:33 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:33 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:34 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:34 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48
Apr 15 14:41:34 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:34 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.465s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:34 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da
Apr 15 14:41:34 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:34 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4.5c4c05c0-5776-40cf-a306-ac47f7b9bf48" returned: 0 in 0.430s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5c4c05c0-5776-40cf-a306-ac47f7b9bf48" released by "_delete_snapshot" :: held 1.921s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" released by "delete_snapshot" :: held 1.934s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Created reservations ['8257c59c-515f-48ed-a8e8-0ae9e4cb5f45', 'd4a53a27-2297-4685-97d8-8e0ddd1c907a', 'd9250c00-2f15-4348-b237-8c81f0e879cd', 'a386e882-1a12-405e-9e33-77dfde0cbdf2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Delete snapshot completed successfully.
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ca5259b-85c7-4b4c-bbb6-8fd9c88111da tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-5c4c05c0-5776-40cf-a306-ac47f7b9bf48-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:34 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:34 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da
Apr 15 14:41:34 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-5b56f910-9c56-40a1-a44a-29584b6428d4-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-5b56f910-9c56-40a1-a44a-29584b6428d4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3d3f4-7ad5-4157-a5e9-00d6712b616a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:35 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4
Apr 15 14:41:35 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:35 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3.7c83f5fd-5b25-4917-b57f-962569dc51da" returned: 0 in 0.440s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-7c83f5fd-5b25-4917-b57f-962569dc51da" released by "_delete_snapshot" :: held 1.904s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.806s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69700206-f1ec-4661-a734-0c25c746a687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905aafea-3841-4ca0-8c99-1e4319d7da9c', 'volume_size': 2, 'source_volid': '62e64902-2490-4556-a992-537a4dfe00a3', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0df4dfe-0fa0-4b80-b0fd-c0f2dc08539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:35 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Volume volume-905aafea-3841-4ca0-8c99-1e4319d7da9c (905aafea-3841-4ca0-8c99-1e4319d7da9c): created successfully
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0df4dfe-0fa0-4b80-b0fd-c0f2dc08539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Flow 'volume_create_manager' (4753a4d6-9378-46ec-83a5-18897943c7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1d6335d9-694c-4094-9f66-f52d31cd90bd tempest-VolumesCloneTest-1687442596 None] Created volume successfully.
Apr 15 14:41:35 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4" returned: 0 in 0.467s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:35 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4
Apr 15 14:41:35 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Acquiring lock "cinder-905aafea-3841-4ca0-8c99-1e4319d7da9c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Lock "cinder-905aafea-3841-4ca0-8c99-1e4319d7da9c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Acquiring lock "cinder-quobyte-905aafea-3841-4ca0-8c99-1e4319d7da9c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-905aafea-3841-4ca0-8c99-1e4319d7da9c" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca1b13-b41a-4314-8af3-705439a69d4d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:35 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c
Apr 15 14:41:35 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:35 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5b56f910-9c56-40a1-a44a-29584b6428d4" returned: 0 in 0.417s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-quobyte-5b56f910-9c56-40a1-a44a-29584b6428d4" released by "delete_volume" :: held 0.911s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Created reservations ['028bf549-db48-4dfc-84a3-a7abb95c7b80', '8e84b16f-4b32-453c-9394-dc8c33d0d7a7', '9bffff70-ffd1-4957-a1ec-2be4ef6a3abc', '2d3e8960-d875-4f44-a5d8-f0b8acf261b2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:35 devstack sudo[89977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:35 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:36 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:36 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c
Apr 15 14:41:36 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:36 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Deleted volume successfully.
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08f6647e-8aed-4b28-bd35-8f132d092a1f tempest-VolumesSnapshotListTestJSON-1097566630 None] Lock "cinder-5b56f910-9c56-40a1-a44a-29584b6428d4-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:36 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-905aafea-3841-4ca0-8c99-1e4319d7da9c" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-905aafea-3841-4ca0-8c99-1e4319d7da9c" released by "delete_volume" :: held 1.048s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Created reservations ['cbd969cf-09a3-4aba-88df-e6f3aba9662e', 'ae2ac5ca-240d-4f7c-be4c-1510bf1fef38', 'b2ed01c4-f05b-487a-946d-0d1b568ee3fe', 'c488a818-50eb-4e36-9d91-ab6d64fd152f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:36 devstack sudo[89986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:36 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:37 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Deleted volume successfully.
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1c04c88-b1b5-4727-9f99-ccd4b629ff5c tempest-VolumesCloneTest-1687442596 None] Lock "cinder-905aafea-3841-4ca0-8c99-1e4319d7da9c-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Acquiring lock "cinder-62e64902-2490-4556-a992-537a4dfe00a3-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Lock "cinder-62e64902-2490-4556-a992-537a4dfe00a3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Acquiring lock "cinder-quobyte-62e64902-2490-4556-a992-537a4dfe00a3" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-62e64902-2490-4556-a992-537a4dfe00a3" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[12afe666-c913-47dd-9e5f-2000076d2070]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:38 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:38 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:38 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.522s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:38 devstack sudo[90001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3
Apr 15 14:41:38 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:38 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-62e64902-2490-4556-a992-537a4dfe00a3" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Lock "cinder-quobyte-62e64902-2490-4556-a992-537a4dfe00a3" released by "delete_volume" :: held 1.025s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Created reservations ['69b99fcc-4bae-4c7d-af33-45ce98b3ad52', 'd7059d90-f86a-4416-94ce-b5a493a8b02e', '800f2f06-1f85-4638-8c0c-801616184261', 'bcd6e47f-1798-44da-a053-3fd0ff4b78e9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:39 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:39 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:39 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.423s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Deleted volume successfully.
Apr 15 14:41:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-387e34ec-cd4f-4719-ae18-db71af11a74d tempest-VolumesCloneTest-1687442596 None] Lock "cinder-62e64902-2490-4556-a992-537a4dfe00a3-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (4104712f-502f-47e9-b15a-e4252b058c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13c2147-cd92-41c1-8e03-05dc696fc9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=107,cinder:SELECT=80,cinder:INSERT=21,cinder:DELETE=11 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13c2147-cd92-41c1-8e03-05dc696fc9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1118053416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55bedfe-3db8-480b-9d6e-4d8c7cbc3377,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:42Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248dd447-2ea6-48c6-b79f-f54f48097492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248dd447-2ea6-48c6-b79f-f54f48097492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607aec2d-e377-49be-89df-3dd8bb6df8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607aec2d-e377-49be-89df-3dd8bb6df8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55bedfe-3db8-480b-9d6e-4d8c7cbc3377', 'volume_name': 'volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d5081b-d054-4e3c-b51e-b0f1bd018a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d5081b-d054-4e3c-b51e-b0f1bd018a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826cce6c-5aee-46d8-bf9e-7927d56479ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Volume b55bedfe-3db8-480b-9d6e-4d8c7cbc3377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377', 'volume_size': 1}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1118053416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55bedfe-3db8-480b-9d6e-4d8c7cbc3377,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:42Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Creating volume b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:41:42 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:42 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 1073741824
Apr 15 14:41:42 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:42 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 1073741824" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:42 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377
Apr 15 14:41:42 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:43 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826cce6c-5aee-46d8-bf9e-7927d56479ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5f1fe6-1f71-43e1-8361-a0485dbc5d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Volume volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 (b55bedfe-3db8-480b-9d6e-4d8c7cbc3377): created successfully
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5f1fe6-1f71-43e1-8361-a0485dbc5d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (4104712f-502f-47e9-b15a-e4252b058c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-991ebf95-7edd-4174-8201-680ac90b4c84 tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (7fb38875-4705-4dce-8adb-2484d1922b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9584391-f6d2-46d8-9a15-e469a0f02d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9584391-f6d2-46d8-9a15-e469a0f02d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-204309954',display_name='tempest-VolumesGetTest-Volume-1289951348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02183ce9-e3e7-428b-a5e2-95b15dd7c1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:44Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036fede8-4dd6-4aee-972a-3c7ee9c3147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036fede8-4dd6-4aee-972a-3c7ee9c3147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f58ba31-1d88-49bb-bb2e-a555e24e3f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f58ba31-1d88-49bb-bb2e-a555e24e3f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02183ce9-e3e7-428b-a5e2-95b15dd7c1e5', 'volume_name': 'volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4fbb96-5f07-496e-b62c-6447572dbbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4fbb96-5f07-496e-b62c-6447572dbbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425e00fe-9855-4225-a2ee-286ea697bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Volume 02183ce9-e3e7-428b-a5e2-95b15dd7c1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5', 'volume_size': 1}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-204309954',display_name='tempest-VolumesGetTest-Volume-1289951348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02183ce9-e3e7-428b-a5e2-95b15dd7c1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:44Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Creating volume 02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:41:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:44 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 1073741824
Apr 15 14:41:44 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:45 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 1073741824" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:45 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5
Apr 15 14:41:45 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:45 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425e00fe-9855-4225-a2ee-286ea697bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b20e213-8340-46d9-944f-104c670a9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Volume volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 (02183ce9-e3e7-428b-a5e2-95b15dd7c1e5): created successfully
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b20e213-8340-46d9-944f-104c670a9185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (7fb38875-4705-4dce-8adb-2484d1922b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1b808e97-bd0d-43ac-ba4f-4952e926fd99 tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Lock "cinder-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2859b868-9804-480c-bbed-3571d7aa016f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:46 devstack sudo[90058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5
Apr 15 14:41:46 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:47 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:47 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5
Apr 15 14:41:47 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:47 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:47 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:47 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5" returned: 0 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5" released by "delete_volume" :: held 1.041s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Created reservations ['dc2b29e8-3269-4a7c-a199-a8bf209c1a5b', 'd545790f-94fd-4b0c-8d7e-98f675ffc6be', 'cd8f80e1-fa6c-47f5-b13a-4758bbdfe91f', '77570870-425b-4943-9b04-641e30c7df63'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:47 devstack sudo[90069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:47 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:48 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:48 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.444s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf38776b-618d-449e-89f8-9cda99935b09 tempest-VolumesGetTest-413603279 None] Lock "cinder-02183ce9-e3e7-428b-a5e2-95b15dd7c1e5-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Lock "cinder-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2babcca6-85b1-46e3-adef-7adad7ace4c7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:49 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377
Apr 15 14:41:49 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:49 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377" returned: 0 in 0.493s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:49 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377
Apr 15 14:41:49 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:49 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377" returned: 0 in 0.458s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377" released by "delete_volume" :: held 0.987s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Created reservations ['317ab4eb-5147-4ab4-a7b5-f68aa998611a', '898817b6-69a0-4549-bc7a-1f87d2651caf', 'dfe8454e-867d-49f5-b83f-f631d4de29f2', '5d80aada-85d6-4615-8330-abce10714960'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:50 devstack sudo[90081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:41:50 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:50 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.411s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:41:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:41:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-34f3e0cc-093b-4541-8a19-bd2f1470dfc5 tempest-VolumesGetTest-413603279 None] Lock "cinder-b55bedfe-3db8-480b-9d6e-4d8c7cbc3377-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (6b811c43-c216-4bb8-992e-92e04f79bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87206806-a964-420a-b39f-9ae79a915e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87206806-a964-420a-b39f-9ae79a915e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1928425060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f89d42-4bfd-411c-9bc8-a4706bc20854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:51Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89d81d6-1014-4775-816a-3344c1adc260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89d81d6-1014-4775-816a-3344c1adc260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae883de-72af-4211-9e4b-0b7b43fc487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae883de-72af-4211-9e4b-0b7b43fc487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f89d42-4bfd-411c-9bc8-a4706bc20854', 'volume_name': 'volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea34d43-d760-41ef-b7ac-2439672e2b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea34d43-d760-41ef-b7ac-2439672e2b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf67e3f-5ecb-4093-931b-8e55cb4ec001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:51 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Volume d1f89d42-4bfd-411c-9bc8-a4706bc20854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854', 'volume_size': 1}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1928425060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f89d42-4bfd-411c-9bc8-a4706bc20854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:51Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Creating volume d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:41:51 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:51 devstack sudo[90084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 1073741824
Apr 15 14:41:51 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:51 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 1073741824" returned: 0 in 0.584s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:52 devstack sudo[90089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:41:52 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:52 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.516s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf67e3f-5ecb-4093-931b-8e55cb4ec001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e7b839-20a8-4ada-becc-f92280323450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:52 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Volume volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 (d1f89d42-4bfd-411c-9bc8-a4706bc20854): created successfully
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e7b839-20a8-4ada-becc-f92280323450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (6b811c43-c216-4bb8-992e-92e04f79bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-67d907f8-341d-4421-aa98-0fd3b94cfcac tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Flow 'volume_create_manager' (c863df0b-bc1d-4719-8a53-1356da17acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5d1f67-77c4-4268-89d8-49acc620462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5d1f67-77c4-4268-89d8-49acc620462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-325464087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b207d92-9aed-40dd-8010-bf56cda167e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7476336ab8d458eb77a8b78ca3c421f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:53Z,use_quota=True,user_id='03ae0ca56c434170b2f1770006c1fa50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a49deb-2283-43e6-a836-33aabb26c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a49deb-2283-43e6-a836-33aabb26c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dedd0d-6a97-4d47-aeaf-9b4551063c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dedd0d-6a97-4d47-aeaf-9b4551063c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b207d92-9aed-40dd-8010-bf56cda167e2', 'volume_name': 'volume-8b207d92-9aed-40dd-8010-bf56cda167e2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c5aa61-cadd-4968-9096-d0612098ae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c5aa61-cadd-4968-9096-d0612098ae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07459c22-e1a2-4386-9b0a-dee4b3b6ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:52 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Volume 8b207d92-9aed-40dd-8010-bf56cda167e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b207d92-9aed-40dd-8010-bf56cda167e2', 'volume_size': 1}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-325464087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b207d92-9aed-40dd-8010-bf56cda167e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7476336ab8d458eb77a8b78ca3c421f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:53Z,use_quota=True,user_id='03ae0ca56c434170b2f1770006c1fa50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Creating volume 8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:41:52 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:41:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:52 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 1073741824
Apr 15 14:41:52 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:53 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 1073741824" returned: 0 in 0.480s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:53 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:41:53 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:53 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.424s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07459c22-e1a2-4386-9b0a-dee4b3b6ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b207d92-9aed-40dd-8010-bf56cda167e2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f492ff1-58a8-40fb-9b86-667ac44304cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Volume volume-8b207d92-9aed-40dd-8010-bf56cda167e2 (8b207d92-9aed-40dd-8010-bf56cda167e2): created successfully
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f492ff1-58a8-40fb-9b86-667ac44304cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Flow 'volume_create_manager' (c863df0b-bc1d-4719-8a53-1356da17acf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-165bc0b4-dc08-40ed-b923-ef067883b8c9 tempest-SnapshotDependencyTests-913098861 None] Created volume successfully.
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (5c7048e7-4fbf-4acb-8bb2-a7e8d331f752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4491682f-6f25-48ab-b42f-0a9918d2447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4491682f-6f25-48ab-b42f-0a9918d2447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1472968561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37dc824-c030-46b1-9fb0-3a14f0edbc4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d1f89d42-4bfd-411c-9bc8-a4706bc20854,status='creating',terminated_at=None,updated_at=2026-04-15T12:41:54Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40de32b0-ceb2-4ac5-93fc-4bc28baadcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40de32b0-ceb2-4ac5-93fc-4bc28baadcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27c80ce-c4c0-48f8-a5fd-f14d64254f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27c80ce-c4c0-48f8-a5fd-f14d64254f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c37dc824-c030-46b1-9fb0-3a14f0edbc4f', 'volume_name': 'volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f', 'volume_size': 1, 'source_volid': 'd1f89d42-4bfd-411c-9bc8-a4706bc20854', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19017f2-038b-4f62-8ec3-143d733f89be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19017f2-038b-4f62-8ec3-143d733f89be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cefa9f-97de-46e7-bb68-6f72abc733d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:41:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Volume c37dc824-c030-46b1-9fb0-3a14f0edbc4f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f', 'volume_size': 1, 'source_volid': 'd1f89d42-4bfd-411c-9bc8-a4706bc20854', 'source_volstatus': 'available'}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:53 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Cloning volume d1f89d42-4bfd-411c-9bc8-a4706bc20854 to volume c37dc824-c030-46b1-9fb0-3a14f0edbc4f
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Creating offline snapshot 72f4d19c-13cc-410f-903d-10dba6154dae of volume d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edccf8f-71e6-4b43-9fc2-8d69d39fe031]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:53 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:41:53 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:54 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:54 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae 1G
Apr 15 14:41:54 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:54 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae 1G" returned: 0 in 0.464s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:54 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae
Apr 15 14:41:54 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:55 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:55 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae is being set with open permissions: ugo+rw
Apr 15 14:41:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:55 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae
Apr 15 14:41:55 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:55 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae" returned: 0 in 0.394s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:55 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info
Apr 15 14:41:55 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:56 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info" returned: 0 in 0.415s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info is being set with open permissions: ugo+rw
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:56 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info
Apr 15 14:41:56 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:56 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.info" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] snapshot: 72f4d19c-13cc-410f-903d-10dba6154dae, volume: c37dc824-c030-46b1-9fb0-3a14f0edbc4f,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e65853a-7d28-4bef-8551-cafb096c80c0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:56 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae
Apr 15 14:41:56 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:56 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b1084a-365a-4719-ba1c-ae63696c17d1]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:57 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:41:57 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:57 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:57 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:41:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:57 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f
Apr 15 14:41:57 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:41:59 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 15 14:41:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" returned: 0 in 2.112s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:41:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[604d153e-913d-45ef-9e8c-f4d73eff99bc]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:41:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:41:59 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:41:59 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:00 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.648s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:42:00 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Converted 1024.00 MB image at 484.65 MB/s
Apr 15 14:42:00 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f is being set with open permissions: ugo+rw
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:00 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f
Apr 15 14:42:00 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:00 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" returned: 0 in 0.396s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" released by "_copy_volume_from_snapshot" :: held 4.141s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-72f4d19c-13cc-410f-903d-10dba6154dae" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-72f4d19c-13cc-410f-903d-10dba6154dae" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Deleting offline snapshot 72f4d19c-13cc-410f-903d-10dba6154dae of volume d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] snapshot_file for this snap is: volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[944624fa-f849-4427-b186-c5b361b4eeb9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:00 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae
Apr 15 14:42:00 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:01 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:42:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1956ab0d-2192-4769-b34e-0091f2702628]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:01 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:42:01 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:01 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.498s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:01 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae
Apr 15 14:42:01 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:02 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:02 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae
Apr 15 14:42:02 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:02 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854.72f4d19c-13cc-410f-903d-10dba6154dae" returned: 0 in 0.433s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-72f4d19c-13cc-410f-903d-10dba6154dae" released by "_delete_snapshot" :: held 1.943s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=89,cinder:UPDATE=109,cinder:INSERT=31,cinder:DELETE=5 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.776s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.665s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cefa9f-97de-46e7-bb68-6f72abc733d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f', 'volume_size': 1, 'source_volid': 'd1f89d42-4bfd-411c-9bc8-a4706bc20854', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b7b398-f571-49b1-af9d-4df7e0bccef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Creating offline snapshot 29db1e59-a8e0-49f3-88e5-289ff3a3e545 of volume 8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:42:02 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Volume volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f (c37dc824-c030-46b1-9fb0-3a14f0edbc4f): created successfully
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b7b398-f571-49b1-af9d-4df7e0bccef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (5c7048e7-4fbf-4acb-8bb2-a7e8d331f752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf982f3a-15b8-4404-98e7-9f06cb587511]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1e2d66a3-bfe5-4a35-b0e3-51d579524998 tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:42:02 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:42:02 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:03 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:03 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 1G
Apr 15 14:42:03 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:03 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 1G" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b207d92-9aed-40dd-8010-bf56cda167e2 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:03 devstack sudo[90184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b207d92-9aed-40dd-8010-bf56cda167e2 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545
Apr 15 14:42:03 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (89a054ba-6cee-4597-b4df-efb97968cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806a6312-2d29-436a-a59d-0ada627444d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806a6312-2d29-436a-a59d-0ada627444d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2129433412',display_name='tempest-VolumesGetTest-Volume-1856352171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c376312-b186-45ba-b144-ec09bc5225d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:04Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3e694e-9abe-4636-aa8d-9b7a56fd1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3e694e-9abe-4636-aa8d-9b7a56fd1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7bf65e-23f7-4f01-ad90-a89996b2d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7bf65e-23f7-4f01-ad90-a89996b2d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c376312-b186-45ba-b144-ec09bc5225d7', 'volume_name': 'volume-5c376312-b186-45ba-b144-ec09bc5225d7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0568b6-8b9f-4a6b-bbd9-50ea2c3a2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0568b6-8b9f-4a6b-bbd9-50ea2c3a2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a7d0b4-67e4-4e33-a846-356aedd4e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Volume 5c376312-b186-45ba-b144-ec09bc5225d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c376312-b186-45ba-b144-ec09bc5225d7', 'volume_size': 1}
Apr 15 14:42:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:04 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b207d92-9aed-40dd-8010-bf56cda167e2 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:04 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 is being set with open permissions: ugo+rw
Apr 15 14:42:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:04 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545
Apr 15 14:42:04 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:04 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545" returned: 0 in 0.426s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:04 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info
Apr 15 14:42:04 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:04 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info" returned: 0 in 0.431s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:04 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info is being set with open permissions: ugo+rw
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:05 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info
Apr 15 14:42:05 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:05 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.info" returned: 0 in 0.434s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2129433412',display_name='tempest-VolumesGetTest-Volume-1856352171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c376312-b186-45ba-b144-ec09bc5225d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:04Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Creating volume 5c376312-b186-45ba-b144-ec09bc5225d7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:05 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7 1073741824
Apr 15 14:42:05 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ea01ee35-e37e-4184-9065-66662da89b52 tempest-SnapshotDependencyTests-913098861 None] Create snapshot completed successfully
Apr 15 14:42:05 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7 1073741824" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:05 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7
Apr 15 14:42:06 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:06 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a7d0b4-67e4-4e33-a846-356aedd4e4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c376312-b186-45ba-b144-ec09bc5225d7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccf5258-9adf-421f-83a5-078c286d97d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Volume volume-5c376312-b186-45ba-b144-ec09bc5225d7 (5c376312-b186-45ba-b144-ec09bc5225d7): created successfully
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccf5258-9adf-421f-83a5-078c286d97d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (89a054ba-6cee-4597-b4df-efb97968cf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6a0a48ff-c0b8-48f1-8637-29a69f253172 tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Flow 'volume_create_manager' (3f913948-245b-4eab-8858-ad0703279710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f1b8c2-92eb-4720-8ef5-d6cb6d85a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f1b8c2-92eb-4720-8ef5-d6cb6d85a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db04e3-e5c4-4865-9bfa-0941fe862b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7476336ab8d458eb77a8b78ca3c421f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29db1e59-a8e0-49f3-88e5-289ff3a3e545,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:07Z,use_quota=True,user_id='03ae0ca56c434170b2f1770006c1fa50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb5c09c-3209-445f-bec8-d3e4f20113ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb5c09c-3209-445f-bec8-d3e4f20113ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d71a9e4-e8ba-4b90-b637-4e31a7ac4af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d71a9e4-e8ba-4b90-b637-4e31a7ac4af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3db04e3-e5c4-4865-9bfa-0941fe862b27', 'volume_name': 'volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27', 'volume_size': 1, 'snapshot_id': '29db1e59-a8e0-49f3-88e5-289ff3a3e545'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2754442d-a02f-4b7e-97ae-8d77d8149555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2754442d-a02f-4b7e-97ae-8d77d8149555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5878153-9a0c-481a-bc11-816393d2201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Volume b3db04e3-e5c4-4865-9bfa-0941fe862b27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27', 'volume_size': 1, 'snapshot_id': '29db1e59-a8e0-49f3-88e5-289ff3a3e545'}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-quobyte-29db1e59-a8e0-49f3-88e5-289ff3a3e545-b3db04e3-e5c4-4865-9bfa-0941fe862b27" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-29db1e59-a8e0-49f3-88e5-289ff3a3e545-b3db04e3-e5c4-4865-9bfa-0941fe862b27" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Creating volume b3db04e3-e5c4-4865-9bfa-0941fe862b27 from snapshot 29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-quobyte-b3db04e3-e5c4-4865-9bfa-0941fe862b27" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-b3db04e3-e5c4-4865-9bfa-0941fe862b27" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] snapshot: 29db1e59-a8e0-49f3-88e5-289ff3a3e545, volume: b3db04e3-e5c4-4865-9bfa-0941fe862b27,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[24baf9fd-1b97-4562-9d96-ec73fdeb3cff]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:06 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545
Apr 15 14:42:06 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-5c376312-b186-45ba-b144-ec09bc5225d7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Lock "cinder-5c376312-b186-45ba-b144-ec09bc5225d7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-5c376312-b186-45ba-b144-ec09bc5225d7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-5c376312-b186-45ba-b144-ec09bc5225d7" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acbcff0-18f5-4321-ac14-9c2286819f06]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:07 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b207d92-9aed-40dd-8010-bf56cda167e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89d108-fe87-435e-bd7c-530218bf5a9d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:07 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7
Apr 15 14:42:07 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:07 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:42:07 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:07 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:07 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7
Apr 15 14:42:07 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:07 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:42:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:07 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27
Apr 15 14:42:07 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:08 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5c376312-b186-45ba-b144-ec09bc5225d7" returned: 0 in 0.430s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-5c376312-b186-45ba-b144-ec09bc5225d7" released by "delete_volume" :: held 0.941s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Created reservations ['e03cde27-5436-4bff-ae32-48d6bdab04f7', '1fbd4cab-c6d2-4b7e-adbc-b6b6ae9b4ce8', '09d337d6-946b-440f-a2cf-aa7d731d8f6b', 'aac636de-6e3b-40b5-9b72-609761055e9d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:08 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:08 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-c37dc824-c030-46b1-9fb0-3a14f0edbc4f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Lock "cinder-c37dc824-c030-46b1-9fb0-3a14f0edbc4f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa1cf5-0885-4dd9-8be7-175ccf362a88]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:09 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f
Apr 15 14:42:09 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:09 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-765753e7-8e38-4a42-b7c0-673707e3e9e5 tempest-VolumesGetTest-413603279 None] Lock "cinder-5c376312-b186-45ba-b144-ec09bc5225d7-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:09 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27" returned: 0 in 2.238s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25fc80-4147-4fa7-9be5-eec7d8519b45]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:09 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" returned: 0 in 1.143s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:10 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f
Apr 15 14:42:10 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:10 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:42:10 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:10 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" returned: 0 in 0.402s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-c37dc824-c030-46b1-9fb0-3a14f0edbc4f" released by "delete_volume" :: held 1.590s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Created reservations ['4ee95b8d-aade-424d-a1cb-6d85c5931a4d', '1d50626f-3ca1-4031-83ae-8d473b93a8ee', '9acd1128-0db8-4850-917e-62f68c7ef688', 'ed25507f-17f4-4f6d-bee3-5a12886a67cf'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:10 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:10 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:10 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:42:10 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Converted 1024.00 MB image at 457.25 MB/s
Apr 15 14:42:10 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 is being set with open permissions: ugo+rw
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:10 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27
Apr 15 14:42:10 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:10 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.433s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afef7815-9e85-4a0a-ac73-878e037f4acc tempest-VolumesGetTest-413603279 None] Lock "cinder-c37dc824-c030-46b1-9fb0-3a14f0edbc4f-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-d1f89d42-4bfd-411c-9bc8-a4706bc20854-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Lock "cinder-d1f89d42-4bfd-411c-9bc8-a4706bc20854-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-d1f89d42-4bfd-411c-9bc8-a4706bc20854" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-d1f89d42-4bfd-411c-9bc8-a4706bc20854" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[165590c6-bf1b-4356-ba14-23f72597a599]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:11 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-b3db04e3-e5c4-4865-9bfa-0941fe862b27" released by "_copy_volume_from_snapshot" :: held 4.357s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-29db1e59-a8e0-49f3-88e5-289ff3a3e545-b3db04e3-e5c4-4865-9bfa-0941fe862b27" released by "_create_volume_from_snapshot" :: held 4.372s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.380s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:11 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:42:11 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5878153-9a0c-481a-bc11-816393d2201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27', 'volume_size': 1, 'snapshot_id': '29db1e59-a8e0-49f3-88e5-289ff3a3e545'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfac4800-c240-4bd7-8953-ddec0c35f74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Volume volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 (b3db04e3-e5c4-4865-9bfa-0941fe862b27): created successfully
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfac4800-c240-4bd7-8953-ddec0c35f74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Flow 'volume_create_manager' (3f913948-245b-4eab-8858-ad0703279710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-87943d9b-2915-4305-b9f4-5744dad34f84 tempest-SnapshotDependencyTests-913098861 None] Created volume successfully.
Apr 15 14:42:11 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:11 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854
Apr 15 14:42:11 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:11 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d1f89d42-4bfd-411c-9bc8-a4706bc20854" returned: 0 in 0.424s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-d1f89d42-4bfd-411c-9bc8-a4706bc20854" released by "delete_volume" :: held 0.929s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Created reservations ['1768c6fa-3290-4e0a-8e99-532b0825e8c8', '97cff5b4-434f-46a8-aa4c-c224acdff2db', '5d4ee934-5366-496c-875c-9da0ce5e11e9', '9523d0b5-ce22-499c-af81-6f5f39692f0e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:12 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:12 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-29db1e59-a8e0-49f3-88e5-289ff3a3e545-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-29db1e59-a8e0-49f3-88e5-289ff3a3e545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-quobyte-8b207d92-9aed-40dd-8010-bf56cda167e2" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-8b207d92-9aed-40dd-8010-bf56cda167e2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-quobyte-29db1e59-a8e0-49f3-88e5-289ff3a3e545" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-29db1e59-a8e0-49f3-88e5-289ff3a3e545" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Deleting offline snapshot 29db1e59-a8e0-49f3-88e5-289ff3a3e545 of volume 8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] snapshot_file for this snap is: volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[446fb74e-2c74-46cd-af83-10e2caa17cb5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:12 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545
Apr 15 14:42:12 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (2de88dd1-5a31-4d7f-8eac-6da906457f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a69299e-8f68-46a9-9c48-1e4b8d346f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:12 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a69299e-8f68-46a9-9c48-1e4b8d346f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544794309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a25596-fc99-4518-9089-7856f89f4c9f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:12Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0593b7-1756-4ebb-b175-d72af6ab3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0593b7-1756-4ebb-b175-d72af6ab3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5f4d74-ad19-4a0e-bf2e-a751deef9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.image.glance [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.523s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-334621ec-af4c-4023-b3ef-dfcf91e9260a tempest-VolumesGetTest-413603279 None] Lock "cinder-d1f89d42-4bfd-411c-9bc8-a4706bc20854-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5f4d74-ad19-4a0e-bf2e-a751deef9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9a25596-fc99-4518-9089-7856f89f4c9f', 'volume_name': 'volume-e9a25596-fc99-4518-9089-7856f89f4c9f', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4bac43640>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1612e37a-a34b-4cab-b8b1-40496ac1286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1612e37a-a34b-4cab-b8b1-40496ac1286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fffd6b1-288f-4668-9c32-d376e7753dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Volume e9a25596-fc99-4518-9089-7856f89f4c9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9a25596-fc99-4518-9089-7856f89f4c9f', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4bac43640>}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Trying to clone e9a25596-fc99-4518-9089-7856f89f4c9f from image 87fa765b-69f0-4eaa-9650-38ed64870330 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 15 14:42:12 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b207d92-9aed-40dd-8010-bf56cda167e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d83aba9-c322-4bc0-a73e-accad353c3de]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:12 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:42:12 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 15 14:42:12 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Image download 20.69 MB at 20.69 MB/s
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff6eff2-3e88-4f90-83aa-345571a8fcef]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:12 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD
Apr 15 14:42:12 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:13 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:13 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545
Apr 15 14:42:13 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:13 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 is fetched for user 302c01b048ab45229e131c5e1cf0faf9. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84ef82a-79f2-4624-b444-1b1d1986d63d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:13 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD
Apr 15 14:42:13 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:13 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545" returned: 0 in 0.463s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:13 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545
Apr 15 14:42:13 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:13 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544794309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a25596-fc99-4518-9089-7856f89f4c9f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:12Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Creating volume e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:13 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:13 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f 1073741824
Apr 15 14:42:13 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:14 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2.29db1e59-a8e0-49f3-88e5-289ff3a3e545" returned: 0 in 0.403s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-29db1e59-a8e0-49f3-88e5-289ff3a3e545" released by "_delete_snapshot" :: held 1.994s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-8b207d92-9aed-40dd-8010-bf56cda167e2" released by "delete_snapshot" :: held 2.007s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Created reservations ['833562dd-d29d-4cd8-92e1-88ef01d8d3a6', '9ec60fcb-4cd1-4d4e-bf8a-5380f25d4d14', 'e37f708c-ee37-4d27-a164-24144aaa6b64', 'c66c114b-c5c8-470a-a9a5-345908a005fa'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Delete snapshot completed successfully.
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5621353a-5bca-4e1d-b8b5-465e09e33299 tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-29db1e59-a8e0-49f3-88e5-289ff3a3e545-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:14 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f 1073741824" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:14 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:14 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:14 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 0 in 0.410s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Attempting download of 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume e9a25596-fc99-4518-9089-7856f89f4c9f. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a37c7-bf79-40d9-ae6f-c659f19ce28b]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:14 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq
Apr 15 14:42:14 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-8b207d92-9aed-40dd-8010-bf56cda167e2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-8b207d92-9aed-40dd-8010-bf56cda167e2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-quobyte-8b207d92-9aed-40dd-8010-bf56cda167e2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-8b207d92-9aed-40dd-8010-bf56cda167e2" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0ee83-290d-45d7-9de7-c5d4d77f1eba]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:15 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:42:15 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:15 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:15 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq
Apr 15 14:42:15 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:15 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:15 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2
Apr 15 14:42:15 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:15 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq" returned: 1 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87fa765b-69f0-4eaa-9650-38ed64870330_7ottnoyq' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbfe68c-ec5d-4b32-a267-f478755a72bd]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:15 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD
Apr 15 14:42:15 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:16 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8b207d92-9aed-40dd-8010-bf56cda167e2" returned: 0 in 0.406s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-8b207d92-9aed-40dd-8010-bf56cda167e2" released by "delete_volume" :: held 0.942s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Created reservations ['1f9e50a4-2adf-4803-b72f-78732d524f27', '012b55a3-1f83-4d52-bed8-199412454f10', '7ee249d3-20c0-499f-9f4c-5f1b2815c256', '9b0f3be2-bf6f-4e61-8d17-31aa4b2c3449'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:16 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:16 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-b3db04e3-e5c4-4865-9bfa-0941fe862b27-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-b3db04e3-e5c4-4865-9bfa-0941fe862b27-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:16 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] 87fa765b-69f0-4eaa-9650-38ed64870330 was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:16 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:16 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "cinder-quobyte-b3db04e3-e5c4-4865-9bfa-0941fe862b27" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-b3db04e3-e5c4-4865-9bfa-0941fe862b27" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda568d6-31e7-46f2-91d4-8c7b1bb07a94]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:16 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27
Apr 15 14:42:16 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:16 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.450s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Deleted volume successfully.
Apr 15 14:42:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-202d754f-a3da-4229-9868-82d6cf3c186f tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-8b207d92-9aed-40dd-8010-bf56cda167e2-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:17 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:17 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27
Apr 15 14:42:17 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:17 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 0 in 0.900s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87fa765b-69f0-4eaa-9650-38ed64870330_iqr0zeajdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:42:17 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Converted 112.00 MB image at 112.00 MB/s
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:17 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f 1G
Apr 15 14:42:17 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:17 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b3db04e3-e5c4-4865-9bfa-0941fe862b27" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-quobyte-b3db04e3-e5c4-4865-9bfa-0941fe862b27" released by "delete_volume" :: held 1.021s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Created reservations ['4a4950a0-5b23-4a8d-a0be-6f8dfa7924ac', '5074139e-fcb9-416f-b2a2-2c08035bcc4d', '08c4c520-5ca5-431d-b886-a7f7a6e21cd3', '72ec2f40-930f-4670-ab1d-f79a88cf0167'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:17 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:17 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:17 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f 1G" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb16dd82-ea5c-4b98-b71d-e07ac208f947]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:17 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:17 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:17 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.439s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Deleted volume successfully.
Apr 15 14:42:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-61a4e350-a970-4c38-aa01-22722228ae9b tempest-SnapshotDependencyTests-913098861 None] Lock "cinder-b3db04e3-e5c4-4865-9bfa-0941fe862b27-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:18 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:18 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:18 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:18 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 1 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Downloaded image 87fa765b-69f0-4eaa-9650-38ed64870330 ((None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}])) to volume e9a25596-fc99-4518-9089-7856f89f4c9f successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Temporary image 87fa765b-69f0-4eaa-9650-38ed64870330 for user 302c01b048ab45229e131c5e1cf0faf9 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Marking volume e9a25596-fc99-4518-9089-7856f89f4c9f as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Copying metadata from image 87fa765b-69f0-4eaa-9650-38ed64870330 to e9a25596-fc99-4518-9089-7856f89f4c9f. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Creating volume glance metadata for volume e9a25596-fc99-4518-9089-7856f89f4c9f backed by image 87fa765b-69f0-4eaa-9650-38ed64870330 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fffd6b1-288f-4668-9c32-d376e7753dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a25596-fc99-4518-9089-7856f89f4c9f', 'volume_size': 1, 'image_id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87fa765b-69f0-4eaa-9650-38ed64870330', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c30a73bba99a4edcb141832af27c8607', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87fa765b-69f0-4eaa-9650-38ed64870330', 'created_at': datetime.datetime(2026, 4, 15, 12, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 12, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87fa765b-69f0-4eaa-9650-38ed64870330/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa4bac43640>}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ddcb47-212d-43d3-aede-aaa14882b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:18 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Volume volume-e9a25596-fc99-4518-9089-7856f89f4c9f (e9a25596-fc99-4518-9089-7856f89f4c9f): created successfully
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ddcb47-212d-43d3-aede-aaa14882b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (2de88dd1-5a31-4d7f-8eac-6da906457f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c27a256d-3d08-4204-b2b5-eb3711fa022b tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (d58252b1-441a-4369-a78e-8171538309df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506eba24-5c09-4516-9edd-04a1a5dca0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506eba24-5c09-4516-9edd-04a1a5dca0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1304601529',display_name='tempest-VolumesGetTest-Volume-1927051841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:20Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c50c18-cdf6-44f3-9fa2-f630f8d4f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c50c18-cdf6-44f3-9fa2-f630f8d4f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079c983c-3b9f-4c43-91de-8b8c1ad2809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079c983c-3b9f-4c43-91de-8b8c1ad2809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49', 'volume_name': 'volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859ec037-a4e0-4b79-9b49-fe1649d54ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859ec037-a4e0-4b79-9b49-fe1649d54ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12626d25-4f93-409d-a522-ad713f892d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Volume 6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49', 'volume_size': 1}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1304601529',display_name='tempest-VolumesGetTest-Volume-1927051841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd433c9eb774e248ef842a8609d7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:20Z,use_quota=True,user_id='302c01b048ab45229e131c5e1cf0faf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Creating volume 6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:20 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:20 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 1073741824
Apr 15 14:42:20 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:20 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 1073741824" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:20 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49
Apr 15 14:42:20 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:21 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12626d25-4f93-409d-a522-ad713f892d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cea71a-963a-43d4-beb7-cbe79d73631b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Volume volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 (6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49): created successfully
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cea71a-963a-43d4-beb7-cbe79d73631b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Flow 'volume_create_manager' (d58252b1-441a-4369-a78e-8171538309df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5b66dd8b-70e9-41c7-8591-8f176ca5016b tempest-VolumesGetTest-413603279 None] Created volume successfully.
Apr 15 14:42:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Lock "cinder-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e173f1-847b-46dc-ba69-19f2141ffc4f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:22 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49
Apr 15 14:42:22 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:23 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49" returned: 0 in 0.502s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:23 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49
Apr 15 14:42:23 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:23 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49" released by "delete_volume" :: held 1.025s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Created reservations ['faa572e0-67ab-4212-a43d-d59b5fb77605', '72945f2e-66b5-4636-b3cf-734203ab3224', 'adc3bea1-aae6-4aef-ac3c-7e297efdee3e', '32cb8c48-aad0-45d3-b5b4-f4f7dc331ab0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:23 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:23 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:24 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a91abe4a-cde1-4a1e-8fdd-40d26420544f tempest-VolumesGetTest-413603279 None] Lock "cinder-6ca73ae5-e4a5-4b98-a362-d7c25bdc7e49-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-e9a25596-fc99-4518-9089-7856f89f4c9f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Lock "cinder-e9a25596-fc99-4518-9089-7856f89f4c9f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Acquiring lock "cinder-quobyte-e9a25596-fc99-4518-9089-7856f89f4c9f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-e9a25596-fc99-4518-9089-7856f89f4c9f" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f637cea-1382-410b-bb0c-670b9ddf176e]: (4, 'raw') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:24 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:24 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:25 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:25 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:25 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:25 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 1 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 15 14:42:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:25 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f
Apr 15 14:42:25 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:26 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-e9a25596-fc99-4518-9089-7856f89f4c9f" returned: 0 in 0.404s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Lock "cinder-quobyte-e9a25596-fc99-4518-9089-7856f89f4c9f" released by "delete_volume" :: held 1.411s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Created reservations ['fb8d7f8d-e90d-4e2b-a4a7-fe9f9537f54a', '0655bf79-fe48-4d5a-9bce-cb17e4bbed2f', '17295093-e358-4a06-b9da-77c3deb76a8b', 'c8ee581f-e544-4c0c-a313-3782b9fa0770'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:26 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:26 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:26 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.405s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Deleted volume successfully.
Apr 15 14:42:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b6eb2fc2-28f4-46e2-aecc-9493ac6920f4 tempest-VolumesGetTest-413603279 None] Lock "cinder-e9a25596-fc99-4518-9089-7856f89f4c9f-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Flow 'volume_create_manager' (fdc5e416-a39f-4f4f-bd02-9f90e22ab893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0804d4e-8a01-4722-b12d-1b1c3b4f976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0804d4e-8a01-4722-b12d-1b1c3b4f976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1911816409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc466c6c-6402-4f59-97a7-279b0a651310,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d0766cc54041fab08c85467652fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:28Z,use_quota=True,user_id='18df86234b0a43b2a648e9a3f53fb778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4faa51-3338-4298-b43f-a4a250c163ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4faa51-3338-4298-b43f-a4a250c163ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e7150d-3778-46fd-81ff-5a94b1d0e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e7150d-3778-46fd-81ff-5a94b1d0e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc466c6c-6402-4f59-97a7-279b0a651310', 'volume_name': 'volume-dc466c6c-6402-4f59-97a7-279b0a651310', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc3002d-461e-4d4b-ac53-18541aa88e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc3002d-461e-4d4b-ac53-18541aa88e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf3ef19-f25a-4174-b95f-dc811fcfc82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Volume dc466c6c-6402-4f59-97a7-279b0a651310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc466c6c-6402-4f59-97a7-279b0a651310', 'volume_size': 1}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1911816409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc466c6c-6402-4f59-97a7-279b0a651310,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d0766cc54041fab08c85467652fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:28Z,use_quota=True,user_id='18df86234b0a43b2a648e9a3f53fb778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Creating volume dc466c6c-6402-4f59-97a7-279b0a651310 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:28 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:28 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310 1073741824
Apr 15 14:42:28 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:28 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310 1073741824" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:29 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310
Apr 15 14:42:29 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:29 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310" returned: 0 in 0.399s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf3ef19-f25a-4174-b95f-dc811fcfc82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc466c6c-6402-4f59-97a7-279b0a651310', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff859f39-5354-4a0b-b6e7-f9a2c211a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:29 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Volume volume-dc466c6c-6402-4f59-97a7-279b0a651310 (dc466c6c-6402-4f59-97a7-279b0a651310): created successfully
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff859f39-5354-4a0b-b6e7-f9a2c211a35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Flow 'volume_create_manager' (fdc5e416-a39f-4f4f-bd02-9f90e22ab893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8a0b84fc-7063-4bcf-a8c7-ea29625d670a tempest-VolumesListTestJSON-342933979 None] Created volume successfully.
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Flow 'volume_create_manager' (e5a298fb-b404-46fc-96a6-f02c7038cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52baf2a-d520-4f16-b9ea-3ae38b4ea067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52baf2a-d520-4f16-b9ea-3ae38b4ea067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-110144949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d0766cc54041fab08c85467652fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:30Z,use_quota=True,user_id='18df86234b0a43b2a648e9a3f53fb778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa556922-1a8d-4896-8abf-781218d0395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa556922-1a8d-4896-8abf-781218d0395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b9853a-bddc-4db0-bd4b-0dabaa41f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b9853a-bddc-4db0-bd4b-0dabaa41f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea', 'volume_name': 'volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b33cc00-7980-43b0-b0e7-c6cee45e1693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b33cc00-7980-43b0-b0e7-c6cee45e1693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ac7aca-15d1-481d-94b5-f3efb82549cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:29 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Volume 8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea', 'volume_size': 1}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-110144949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d0766cc54041fab08c85467652fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:30Z,use_quota=True,user_id='18df86234b0a43b2a648e9a3f53fb778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Creating volume 8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:29 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:29 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea 1073741824
Apr 15 14:42:29 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:30 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea 1073741824" returned: 0 in 0.460s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:30 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea
Apr 15 14:42:30 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:30 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea" returned: 0 in 0.398s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ac7aca-15d1-481d-94b5-f3efb82549cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baf0c71-1e21-497b-aed1-3e3edff9954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Volume volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea (8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea): created successfully
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baf0c71-1e21-497b-aed1-3e3edff9954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Flow 'volume_create_manager' (e5a298fb-b404-46fc-96a6-f02c7038cda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8d7ef416-7f1f-4036-85a9-12ecb7b4f95f tempest-VolumesListTestJSON-342933979 None] Created volume successfully.
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Flow 'volume_create_manager' (011bee51-7fc1-45e4-9405-b05dca87ddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe6c83b-6475-4bdf-a391-0fd662d859b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe6c83b-6475-4bdf-a391-0fd662d859b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1944832886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f80e95c-684b-47fe-b15b-4e27b5509d62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d0766cc54041fab08c85467652fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:31Z,use_quota=True,user_id='18df86234b0a43b2a648e9a3f53fb778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160d5a56-17d3-4c2c-b2b8-4df2be0efa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160d5a56-17d3-4c2c-b2b8-4df2be0efa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410c469f-04a2-4bed-b749-9db4751c0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410c469f-04a2-4bed-b749-9db4751c0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f80e95c-684b-47fe-b15b-4e27b5509d62', 'volume_name': 'volume-1f80e95c-684b-47fe-b15b-4e27b5509d62', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b15c1a3-f8bb-402d-ab7d-a598c3ab51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b15c1a3-f8bb-402d-ab7d-a598c3ab51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c7e311-a64f-4db4-8a0a-857efa84db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Volume 1f80e95c-684b-47fe-b15b-4e27b5509d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f80e95c-684b-47fe-b15b-4e27b5509d62', 'volume_size': 1}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1944832886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f80e95c-684b-47fe-b15b-4e27b5509d62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58d0766cc54041fab08c85467652fa6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:31Z,use_quota=True,user_id='18df86234b0a43b2a648e9a3f53fb778',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Creating volume 1f80e95c-684b-47fe-b15b-4e27b5509d62 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:31 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:31 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 1073741824
Apr 15 14:42:31 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:31 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 1073741824" returned: 0 in 0.458s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:31 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62
Apr 15 14:42:31 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:32 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62" returned: 0 in 0.402s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c7e311-a64f-4db4-8a0a-857efa84db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f80e95c-684b-47fe-b15b-4e27b5509d62', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e6ca6d-2b4f-4327-b64b-e7db8bae6275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Volume volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 (1f80e95c-684b-47fe-b15b-4e27b5509d62): created successfully
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e6ca6d-2b4f-4327-b64b-e7db8bae6275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Flow 'volume_create_manager' (011bee51-7fc1-45e4-9405-b05dca87ddf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-54cf1694-b40e-4db5-bb40-fdffc5515c6c tempest-VolumesListTestJSON-342933979 None] Created volume successfully.
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Acquiring lock "cinder-1f80e95c-684b-47fe-b15b-4e27b5509d62-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Lock "cinder-1f80e95c-684b-47fe-b15b-4e27b5509d62-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Acquiring lock "cinder-quobyte-1f80e95c-684b-47fe-b15b-4e27b5509d62" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Lock "cinder-quobyte-1f80e95c-684b-47fe-b15b-4e27b5509d62" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe68794a-a5c6-4a47-ac91-5fe54dc72fa5]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:34 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62
Apr 15 14:42:34 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:34 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:34 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62
Apr 15 14:42:34 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:35 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-1f80e95c-684b-47fe-b15b-4e27b5509d62" returned: 0 in 0.403s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Lock "cinder-quobyte-1f80e95c-684b-47fe-b15b-4e27b5509d62" released by "delete_volume" :: held 0.884s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Created reservations ['3445f356-f6b9-48ff-9eb7-95c6b14f159b', '8e8bafed-067a-49a5-9fb0-eb47f4e3eed0', 'e3b25f92-6538-4020-8b91-8d000c04b8c3', '4270453b-8c30-4f91-9923-043298fb33a2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:35 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:35 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Acquiring lock "cinder-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Acquiring lock "cinder-quobyte-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-quobyte-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e292fd0-f99b-4fc4-a964-681296b03113]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:35 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea
Apr 15 14:42:35 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:35 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.436s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Deleted volume successfully.
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d66c1ed7-48d4-40b7-a323-365463ca767d tempest-VolumesListTestJSON-342933979 None] Lock "cinder-1f80e95c-684b-47fe-b15b-4e27b5509d62-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:35 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:35 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea
Apr 15 14:42:35 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:36 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea" returned: 0 in 0.410s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-quobyte-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea" released by "delete_volume" :: held 0.896s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Created reservations ['e8da29ab-35e4-428f-9f16-5f3e4f04abb8', '1402c457-f83c-4770-bfde-b35e495c3b95', 'd3f275d5-96b0-4bd2-95c5-7d4fa7319481', 'd715a9da-d9b1-460f-b0f2-4f339b05c3df'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:36 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:36 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Acquiring lock "cinder-dc466c6c-6402-4f59-97a7-279b0a651310-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-dc466c6c-6402-4f59-97a7-279b0a651310-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Acquiring lock "cinder-quobyte-dc466c6c-6402-4f59-97a7-279b0a651310" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-quobyte-dc466c6c-6402-4f59-97a7-279b0a651310" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[44156b67-b6f0-465f-97ad-254c1a3dafce]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:36 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310
Apr 15 14:42:36 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:36 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.430s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Deleted volume successfully.
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-195289bd-b650-4081-b385-c6634449c556 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-8c8ee2b6-c3c6-48f6-8333-2ee37ceca1ea-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:36 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:37 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310
Apr 15 14:42:37 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:37 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dc466c6c-6402-4f59-97a7-279b0a651310" returned: 0 in 0.411s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-quobyte-dc466c6c-6402-4f59-97a7-279b0a651310" released by "delete_volume" :: held 0.925s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Created reservations ['d6d581c2-e2a4-4496-b497-aa573141cb5f', 'b12d0f47-58b8-4d85-8a5a-1c1a689f3db9', '2f0698f4-f91f-450c-919b-b2466949de12', '5dc72f35-f069-4dbb-8ced-c4165fd737b7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:37 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:37 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:37 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Deleted volume successfully.
Apr 15 14:42:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1ba828c4-be00-49c3-a5fb-9c11c0717876 tempest-VolumesListTestJSON-342933979 None] Lock "cinder-dc466c6c-6402-4f59-97a7-279b0a651310-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (2dddebf2-f6cc-4ffc-9aba-80532fe0c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3313819-a2c1-4dcf-b9ef-ae501be07364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3313819-a2c1-4dcf-b9ef-ae501be07364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583052248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd34599-5b7d-4a9c-ab27-21eba9dec9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:39Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb726121-43d4-41ae-82cd-72271f688e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb726121-43d4-41ae-82cd-72271f688e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16328d-9f84-4f7d-9063-a5891cd7b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16328d-9f84-4f7d-9063-a5891cd7b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd34599-5b7d-4a9c-ab27-21eba9dec9ce', 'volume_name': 'volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8097e0d9-9e39-48b9-b4c8-8137e2f97c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8097e0d9-9e39-48b9-b4c8-8137e2f97c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec759c3-9e49-470e-b8ad-22456948b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume 6cd34599-5b7d-4a9c-ab27-21eba9dec9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce', 'volume_size': 1}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1583052248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd34599-5b7d-4a9c-ab27-21eba9dec9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:39Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating volume 6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:39 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:39 devstack sudo[90478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce 1073741824
Apr 15 14:42:39 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:39 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce 1073741824" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:39 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce
Apr 15 14:42:39 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:40 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" returned: 0 in 0.412s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec759c3-9e49-470e-b8ad-22456948b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e2c647-6ed2-4424-8808-22172fa6bbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce (6cd34599-5b7d-4a9c-ab27-21eba9dec9ce): created successfully
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e2c647-6ed2-4424-8808-22172fa6bbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (2dddebf2-f6cc-4ffc-9aba-80532fe0c421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2ca01d76-0ff8-43ae-8571-0c7cc86e52b5 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created volume successfully.
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating offline snapshot 94c3244d-3a34-4b06-9059-abaa81abb199 of volume 6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3144c39e-508d-4f96-80c1-61f990546e20]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:41 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce
Apr 15 14:42:41 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:41 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" returned: 0 in 0.483s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:41 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 1G
Apr 15 14:42:41 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:42 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 1G" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:42 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199
Apr 15 14:42:42 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:42 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:42 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 is being set with open permissions: ugo+rw
Apr 15 14:42:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:42 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199
Apr 15 14:42:42 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:43 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199" returned: 0 in 0.409s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:43 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=161,cinder:SELECT=104,cinder:INSERT=36,cinder:DELETE=12 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:42:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:43 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info
Apr 15 14:42:43 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:43 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info" returned: 0 in 0.416s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:43 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info is being set with open permissions: ugo+rw
Apr 15 14:42:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:43 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info
Apr 15 14:42:43 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:43 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.info" returned: 0 in 0.406s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7db20008-adcc-4ec5-99e0-b314e7620a51 tempest-CreateVolumesFromSnapshotTest-103504420 None] Create snapshot completed successfully
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (f5f87ae8-8247-4c40-9b3c-b815df9ee968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee290ef-60e5-4dd9-801c-95cc35d4025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee290ef-60e5-4dd9-801c-95cc35d4025a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68225336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530eb6b1-7a84-4cf4-bfd0-157f2b4e225d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662b875b-03c7-42ee-a764-e6bcb2b045e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662b875b-03c7-42ee-a764-e6bcb2b045e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e0174b-f093-4284-aa77-5f12de8b93f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e0174b-f093-4284-aa77-5f12de8b93f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530eb6b1-7a84-4cf4-bfd0-157f2b4e225d', 'volume_name': 'volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f98d47-de5f-4a1b-b167-cb32f29d6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f98d47-de5f-4a1b-b167-cb32f29d6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b365a1f-f85d-47a4-bb4e-85791ab36cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume 530eb6b1-7a84-4cf4-bfd0-157f2b4e225d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d', 'volume_size': 1}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68225336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530eb6b1-7a84-4cf4-bfd0-157f2b4e225d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating volume 530eb6b1-7a84-4cf4-bfd0-157f2b4e225d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:44 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d 1073741824
Apr 15 14:42:44 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (fe5b6d09-67d0-43e8-8025-28efa3d53a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3e4af4-bf50-481a-b6c3-586d4095ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3e4af4-bf50-481a-b6c3-586d4095ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390158887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03bfc64-ce4f-4350-ae9c-1dcf7dec060d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcae321-16c0-4d76-aeea-fc62b1d35944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcae321-16c0-4d76-aeea-fc62b1d35944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fded1bc1-06ea-470a-a836-fa6a2da9022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fded1bc1-06ea-470a-a836-fa6a2da9022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03bfc64-ce4f-4350-ae9c-1dcf7dec060d', 'volume_name': 'volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a65927-878a-420c-9dff-e132e1847708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a65927-878a-420c-9dff-e132e1847708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7e916c-9c3a-491b-81cb-e3e62a1cde24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume b03bfc64-ce4f-4350-ae9c-1dcf7dec060d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d', 'volume_size': 1}
Apr 15 14:42:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (5c9cb71c-2f67-4044-ac9c-06e1c22b6f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19f1cd9-5766-4bac-b288-4836d6c5cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19f1cd9-5766-4bac-b288-4836d6c5cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943188563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d234db-990b-43b9-86bd-0debb44581b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40414d9-f5f8-4741-8003-536dacc5fa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40414d9-f5f8-4741-8003-536dacc5fa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca36f300-77e2-49cb-83ab-2064b5938207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca36f300-77e2-49cb-83ab-2064b5938207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d234db-990b-43b9-86bd-0debb44581b6', 'volume_name': 'volume-b2d234db-990b-43b9-86bd-0debb44581b6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27004a11-f31b-4153-8a57-4e5276333e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27004a11-f31b-4153-8a57-4e5276333e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef5019d-50a8-4ac6-94b1-2df7a5c262bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume b2d234db-990b-43b9-86bd-0debb44581b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d234db-990b-43b9-86bd-0debb44581b6', 'volume_size': 1}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (a2b798fa-d1a6-4b0c-8d3a-6db01e4e2bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2339bbf8-e708-4d6c-b807-10f89024ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2339bbf8-e708-4d6c-b807-10f89024ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1262360916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db842005-b7cf-4591-9a26-706f97ae84d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f245ed2-6426-4b21-b286-ab2fd4ee83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f245ed2-6426-4b21-b286-ab2fd4ee83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b283641c-df54-44cd-a4a1-b112b4c29c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b283641c-df54-44cd-a4a1-b112b4c29c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db842005-b7cf-4591-9a26-706f97ae84d6', 'volume_name': 'volume-db842005-b7cf-4591-9a26-706f97ae84d6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e43eeb7-7180-4cdc-98ef-c3c23c0a120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e43eeb7-7180-4cdc-98ef-c3c23c0a120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59b2fbc-b958-4681-92d8-6c82667c15a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume db842005-b7cf-4591-9a26-706f97ae84d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db842005-b7cf-4591-9a26-706f97ae84d6', 'volume_size': 1}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:45 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d 1073741824" returned: 0 in 0.642s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:45 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d
Apr 15 14:42:45 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (f272314b-cd5c-45bd-b910-5e002da0f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061245e1-1694-4c0d-92dc-5178a4110fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061245e1-1694-4c0d-92dc-5178a4110fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-887950433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fddd92-5afb-4ffc-885c-50c2194254a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f4a241-48fd-4069-8896-16471ae8a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f4a241-48fd-4069-8896-16471ae8a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a421527-9ae3-42cd-bd95-0ca15e40c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a421527-9ae3-42cd-bd95-0ca15e40c113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fddd92-5afb-4ffc-885c-50c2194254a6', 'volume_name': 'volume-27fddd92-5afb-4ffc-885c-50c2194254a6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d021f338-0451-4ccc-8a10-184b282d432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d021f338-0451-4ccc-8a10-184b282d432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79478e20-da12-457e-946b-df8dc3a3df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume 27fddd92-5afb-4ffc-885c-50c2194254a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fddd92-5afb-4ffc-885c-50c2194254a6', 'volume_size': 1}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:45 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d" returned: 0 in 0.431s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390158887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03bfc64-ce4f-4350-ae9c-1dcf7dec060d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating volume b03bfc64-ce4f-4350-ae9c-1dcf7dec060d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:45 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:45 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d 1073741824
Apr 15 14:42:45 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b365a1f-f85d-47a4-bb4e-85791ab36cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06da2974-6c7e-464f-adb2-3c1d9f8e7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d (530eb6b1-7a84-4cf4-bfd0-157f2b4e225d): created successfully
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06da2974-6c7e-464f-adb2-3c1d9f8e7303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (f5f87ae8-8247-4c40-9b3c-b815df9ee968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-dfa429a6-2635-4a54-9c78-95e392cb4619 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created volume successfully.
Apr 15 14:42:46 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d 1073741824" returned: 0 in 0.464s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:46 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d
Apr 15 14:42:46 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:46 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d" returned: 0 in 0.422s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943188563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d234db-990b-43b9-86bd-0debb44581b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating volume b2d234db-990b-43b9-86bd-0debb44581b6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:46 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7e916c-9c3a-491b-81cb-e3e62a1cde24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80747e-8a59-47b9-ad35-86edcb6befe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:46 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6 1073741824
Apr 15 14:42:46 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d (b03bfc64-ce4f-4350-ae9c-1dcf7dec060d): created successfully
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb80747e-8a59-47b9-ad35-86edcb6befe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (fe5b6d09-67d0-43e8-8025-28efa3d53a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e672d791-02bb-4511-a662-efb395212b5f tempest-CreateVolumesFromSnapshotTest-103504420 None] Created volume successfully.
Apr 15 14:42:47 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6 1073741824" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:47 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6
Apr 15 14:42:47 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:47 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:47 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:47 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6" returned: 0 in 0.443s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1262360916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db842005-b7cf-4591-9a26-706f97ae84d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating volume db842005-b7cf-4591-9a26-706f97ae84d6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:47 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef5019d-50a8-4ac6-94b1-2df7a5c262bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d234db-990b-43b9-86bd-0debb44581b6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:47 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6 1073741824
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a1c955-67e3-4168-a153-7d0173ab5052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:47 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume volume-b2d234db-990b-43b9-86bd-0debb44581b6 (b2d234db-990b-43b9-86bd-0debb44581b6): created successfully
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a1c955-67e3-4168-a153-7d0173ab5052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (5c9cb71c-2f67-4044-ac9c-06e1c22b6f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-073ac4ce-7115-43c1-9ede-0971c59e6f53 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created volume successfully.
Apr 15 14:42:48 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:48 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6 1073741824" returned: 0 in 0.482s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:48 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6
Apr 15 14:42:48 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:48 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6" returned: 0 in 0.424s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-887950433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fddd92-5afb-4ffc-885c-50c2194254a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e404bbaedf8480e8860f08c9a710914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:42:45Z,use_quota=True,user_id='42fd319dc9ea4cf588cddf4caf6fb177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Creating volume 27fddd92-5afb-4ffc-885c-50c2194254a6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:42:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59b2fbc-b958-4681-92d8-6c82667c15a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db842005-b7cf-4591-9a26-706f97ae84d6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e6913f-859a-48d4-8e86-0c4b0476268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:48 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6 1073741824
Apr 15 14:42:48 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume volume-db842005-b7cf-4591-9a26-706f97ae84d6 (db842005-b7cf-4591-9a26-706f97ae84d6): created successfully
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e6913f-859a-48d4-8e86-0c4b0476268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (a2b798fa-d1a6-4b0c-8d3a-6db01e4e2bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-274ef5fa-b5fd-4455-b6ed-8fd9d2e92ebc tempest-CreateVolumesFromSnapshotTest-103504420 None] Created volume successfully.
Apr 15 14:42:49 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6 1073741824" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:49 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6
Apr 15 14:42:49 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:49 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79478e20-da12-457e-946b-df8dc3a3df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fddd92-5afb-4ffc-885c-50c2194254a6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19bc1a2-dc37-4906-b895-5c25feae4506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:42:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Volume volume-27fddd92-5afb-4ffc-885c-50c2194254a6 (27fddd92-5afb-4ffc-885c-50c2194254a6): created successfully
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19bc1a2-dc37-4906-b895-5c25feae4506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Flow 'volume_create_manager' (f272314b-cd5c-45bd-b910-5e002da0f214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:42:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4f3d75e7-8d98-43e7-bdb5-95880ee5f3d3 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created volume successfully.
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-27fddd92-5afb-4ffc-885c-50c2194254a6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-27fddd92-5afb-4ffc-885c-50c2194254a6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-27fddd92-5afb-4ffc-885c-50c2194254a6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-27fddd92-5afb-4ffc-885c-50c2194254a6" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef01b50-10df-4572-aab3-0547011e02ce]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:50 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6
Apr 15 14:42:50 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:50 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6" returned: 0 in 0.456s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:50 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6
Apr 15 14:42:50 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:50 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-27fddd92-5afb-4ffc-885c-50c2194254a6" returned: 0 in 0.392s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-27fddd92-5afb-4ffc-885c-50c2194254a6" released by "delete_volume" :: held 0.869s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['79d5e1e0-fbe4-45b6-9e77-e413206441fb', 'a4b2f542-3e6d-43e9-bbac-0270d9754ba1', '1a500d31-93b9-4a80-9c28-6438095502e5', 'd726547b-a2de-44c6-abad-531003626224'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:50 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:50 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-db842005-b7cf-4591-9a26-706f97ae84d6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-db842005-b7cf-4591-9a26-706f97ae84d6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-db842005-b7cf-4591-9a26-706f97ae84d6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-db842005-b7cf-4591-9a26-706f97ae84d6" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde80d8-bab8-4307-9110-7c9ddc533acb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:51 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6
Apr 15 14:42:51 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:51 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.441s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleted volume successfully.
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cd24fc27-8b30-432a-b0da-a4e82ea6ea0d tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-27fddd92-5afb-4ffc-885c-50c2194254a6-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:51 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6" returned: 0 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:51 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6
Apr 15 14:42:51 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:51 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-db842005-b7cf-4591-9a26-706f97ae84d6" returned: 0 in 0.394s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-db842005-b7cf-4591-9a26-706f97ae84d6" released by "delete_volume" :: held 0.885s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:51 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['4a946262-0ffa-4505-b87c-4a7beff228ac', '9aa0f98b-f189-40e3-8c12-9fa4dc626a82', '12319773-a56e-4ab7-8dbd-2dceafb60342', 'f7aa080b-5321-4836-969f-68c7f9fa56bb'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:52 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:52 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-b2d234db-990b-43b9-86bd-0debb44581b6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-b2d234db-990b-43b9-86bd-0debb44581b6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-b2d234db-990b-43b9-86bd-0debb44581b6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-b2d234db-990b-43b9-86bd-0debb44581b6" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c653f2-3cd8-4016-9f82-43c37f680657]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:52 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6
Apr 15 14:42:52 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:52 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.427s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleted volume successfully.
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4d1a40aa-4689-44c9-a109-dbe7d13b269a tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-db842005-b7cf-4591-9a26-706f97ae84d6-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:52 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:52 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6
Apr 15 14:42:52 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:53 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b2d234db-990b-43b9-86bd-0debb44581b6" returned: 0 in 0.417s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-b2d234db-990b-43b9-86bd-0debb44581b6" released by "delete_volume" :: held 0.910s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['43f80006-e405-44af-8a9d-1eb997d83494', '0c28cb5d-6e60-4aaa-aa77-360b1ec46a22', '6f750f78-3fa1-44cf-aee8-d618cd195533', '55782795-07f0-421e-b942-87332b089f27'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:53 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:53 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb47a86-111a-4ac4-8c99-124bad83f8da]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:53 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d
Apr 15 14:42:53 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:53 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.451s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleted volume successfully.
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89889284-b8a1-4d7c-bb9e-a015b581fcea tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-b2d234db-990b-43b9-86bd-0debb44581b6-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:53 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:53 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d
Apr 15 14:42:53 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:54 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d" returned: 0 in 0.394s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d" released by "delete_volume" :: held 0.904s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['a4dec867-a5d9-4da2-a5d6-c3c98e197ae3', 'e1bf2b75-f09f-4457-974e-e70f96495cc7', 'c3cc12f3-e195-4f90-9b3e-798e630bbb7f', 'cc18915e-da0c-45a1-a10a-56e6b3a7c052'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:54 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:54 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f411e3-ae75-44dd-9162-800e3afe6626]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:54 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d
Apr 15 14:42:54 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:54 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleted volume successfully.
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a38a1c37-773e-4367-a714-3597b49cd7d6 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-b03bfc64-ce4f-4350-ae9c-1dcf7dec060d-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:54 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d" returned: 0 in 0.480s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:54 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d
Apr 15 14:42:54 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:55 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d" returned: 0 in 0.404s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d" released by "delete_volume" :: held 0.907s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['f98110d7-33a1-4700-9f02-b78817141f41', '7757ee77-f1f8-4295-9000-b055ac0c6d1b', 'e8daf9bf-3dae-43a0-b8da-ad64e15ea07e', 'c81b7343-60ed-4e7f-aebe-1c773b8af77d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:55 devstack sudo[90641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:55 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-94c3244d-3a34-4b06-9059-abaa81abb199-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-94c3244d-3a34-4b06-9059-abaa81abb199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-94c3244d-3a34-4b06-9059-abaa81abb199" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-94c3244d-3a34-4b06-9059-abaa81abb199" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleting offline snapshot 94c3244d-3a34-4b06-9059-abaa81abb199 of volume 6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] snapshot_file for this snap is: volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd045bbf-26a4-4414-89ff-66b624395825]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:55 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199
Apr 15 14:42:55 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:55 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleted volume successfully.
Apr 15 14:42:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6b67e13b-3c0b-45b5-ac53-79191acb0460 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-530eb6b1-7a84-4cf4-bfd0-157f2b4e225d-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:56 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199" returned: 0 in 0.487s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b011a-43c3-4493-b591-2ee07c79a321]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:56 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce
Apr 15 14:42:56 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:56 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:56 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199
Apr 15 14:42:56 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:56 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:57 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199
Apr 15 14:42:57 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:57 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce.94c3244d-3a34-4b06-9059-abaa81abb199" returned: 0 in 0.403s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-94c3244d-3a34-4b06-9059-abaa81abb199" released by "_delete_snapshot" :: held 1.874s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" released by "delete_snapshot" :: held 1.884s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['d6503ac5-20c7-4d43-8c38-7c9bd8eb4c9f', '54ef3754-df6f-4c7a-be66-74482dd31965', '8ee978ec-5a9b-49c0-aa5a-9769c6b24f09', 'd5d14ad3-1d69-4260-98ff-d497d6d648e3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Delete snapshot completed successfully.
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d76f7fa4-4e3d-49b0-abfe-2303c7eaaca4 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-94c3244d-3a34-4b06-9059-abaa81abb199-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "cinder-quobyte-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7400a5-0484-4c78-ab34-c86d7693c77d]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:42:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:57 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce
Apr 15 14:42:57 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:58 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:58 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce
Apr 15 14:42:58 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:58 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" returned: 0 in 0.403s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-quobyte-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce" released by "delete_volume" :: held 0.900s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Created reservations ['eae3b9f5-b56c-4099-b3e0-383f7a8f4c15', 'e9f34317-e713-49d3-9722-2eee3bad4e34', '2462921e-3d5c-49d9-9b01-1209712a30cc', '62739c1c-7b15-4817-95da-ebcb1c76dae1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:42:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:42:58 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:42:58 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:42:59 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 15 14:42:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.453s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:42:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:42:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Deleted volume successfully.
Apr 15 14:42:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-21eba1f1-7856-4280-b5b5-43f6a50d5f83 tempest-CreateVolumesFromSnapshotTest-103504420 None] Lock "cinder-6cd34599-5b7d-4a9c-ab27-21eba9dec9ce-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Flow 'volume_create_manager' (5d98112e-097a-430d-8009-b6359bf59579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410df647-e9f0-431b-b8bb-46a679223028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410df647-e9f0-431b-b8bb-46a679223028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8f83e8-b799-47ec-b49f-d3d5d27d59f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ead70414ea49f689de980f97c373e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:00Z,use_quota=True,user_id='236f2fc07ac647d78ca33b31cc3a1e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ac699e-238d-4311-80be-83dee4d02836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ac699e-238d-4311-80be-83dee4d02836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1b6009-d230-4ae8-8df6-6b52181edacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1b6009-d230-4ae8-8df6-6b52181edacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8f83e8-b799-47ec-b49f-d3d5d27d59f1', 'volume_name': 'volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b44279-38a6-4fc4-ae24-56d22c4a872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b44279-38a6-4fc4-ae24-56d22c4a872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dbb71b-1979-4ffc-9cab-3abad596cd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:00 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Volume 2e8f83e8-b799-47ec-b49f-d3d5d27d59f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1', 'volume_size': 1}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8f83e8-b799-47ec-b49f-d3d5d27d59f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ead70414ea49f689de980f97c373e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:00Z,use_quota=True,user_id='236f2fc07ac647d78ca33b31cc3a1e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Creating volume 2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:00 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:00 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 1073741824
Apr 15 14:43:00 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:00 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 1073741824" returned: 0 in 0.467s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:00 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1
Apr 15 14:43:00 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:01 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1" returned: 0 in 0.418s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dbb71b-1979-4ffc-9cab-3abad596cd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c92b9c5-e09a-40a7-8c3c-d392bcabb0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:01 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Volume volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 (2e8f83e8-b799-47ec-b49f-d3d5d27d59f1): created successfully
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c92b9c5-e09a-40a7-8c3c-d392bcabb0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Flow 'volume_create_manager' (5d98112e-097a-430d-8009-b6359bf59579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7104cd5e-dd3c-48eb-97dd-f251e4fc6fe3 tempest-CinderUnicodeTest-2125188418 None] Created volume successfully.
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:DELETE=15,cinder:UPDATE=169,cinder:SELECT=137,cinder:INSERT=54 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Flow 'volume_create_manager' (c91783b1-05ec-4d64-8bd7-499e343ae1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b7a545-0f25-45e1-9f92-b1a767e6ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b7a545-0f25-45e1-9f92-b1a767e6ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1217009321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4870c581-b5fd-484c-91db-e2a0b1b91455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ead70414ea49f689de980f97c373e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:03Z,use_quota=True,user_id='236f2fc07ac647d78ca33b31cc3a1e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddaed07a-68d0-406f-bf25-a63a90831be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddaed07a-68d0-406f-bf25-a63a90831be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754b77e-02f6-47ad-96f8-d41ea3cc0b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754b77e-02f6-47ad-96f8-d41ea3cc0b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4870c581-b5fd-484c-91db-e2a0b1b91455', 'volume_name': 'volume-4870c581-b5fd-484c-91db-e2a0b1b91455', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200099a8-c491-4f2f-8ae8-abf857f2ba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200099a8-c491-4f2f-8ae8-abf857f2ba4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28e1b0d-8c5d-4332-a8ef-536d244fd55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:02 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Volume 4870c581-b5fd-484c-91db-e2a0b1b91455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4870c581-b5fd-484c-91db-e2a0b1b91455', 'volume_size': 1}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1217009321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4870c581-b5fd-484c-91db-e2a0b1b91455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ead70414ea49f689de980f97c373e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:03Z,use_quota=True,user_id='236f2fc07ac647d78ca33b31cc3a1e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Creating volume 4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:02 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:02 devstack sudo[90683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 1073741824
Apr 15 14:43:02 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:03 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 1073741824" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:03 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455
Apr 15 14:43:03 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:03 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455" returned: 0 in 0.437s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28e1b0d-8c5d-4332-a8ef-536d244fd55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4870c581-b5fd-484c-91db-e2a0b1b91455', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbebf837-34ed-4be5-bcbb-c855a5ae8d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Volume volume-4870c581-b5fd-484c-91db-e2a0b1b91455 (4870c581-b5fd-484c-91db-e2a0b1b91455): created successfully
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbebf837-34ed-4be5-bcbb-c855a5ae8d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Flow 'volume_create_manager' (c91783b1-05ec-4d64-8bd7-499e343ae1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ebf4772b-229c-4068-b9f1-56d35210d1a7 tempest-CinderUnicodeTest-2125188418 None] Created volume successfully.
Apr 15 14:43:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Creating offline snapshot dd5cf14d-aa00-47bf-8e72-822519899748 of volume 4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:43:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5fb57a-7c98-4d6a-8c25-10929499cd77]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:04 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455
Apr 15 14:43:04 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:05 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:05 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 1G
Apr 15 14:43:05 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:05 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 1G" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4870c581-b5fd-484c-91db-e2a0b1b91455 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:05 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4870c581-b5fd-484c-91db-e2a0b1b91455 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748
Apr 15 14:43:05 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:06 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4870c581-b5fd-484c-91db-e2a0b1b91455 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748" returned: 0 in 0.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:06 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 is being set with open permissions: ugo+rw
Apr 15 14:43:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:06 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748
Apr 15 14:43:06 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:06 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748" returned: 0 in 0.407s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:06 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info
Apr 15 14:43:06 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:07 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info" returned: 0 in 0.412s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:07 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info is being set with open permissions: ugo+rw
Apr 15 14:43:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:07 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info
Apr 15 14:43:07 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:07 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.info" returned: 0 in 0.407s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1fa28d70-d317-4c09-9975-2ba232ff53b5 tempest-CinderUnicodeTest-2125188418 None] Create snapshot completed successfully
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-dd5cf14d-aa00-47bf-8e72-822519899748-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-dd5cf14d-aa00-47bf-8e72-822519899748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-quobyte-4870c581-b5fd-484c-91db-e2a0b1b91455" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-4870c581-b5fd-484c-91db-e2a0b1b91455" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-quobyte-dd5cf14d-aa00-47bf-8e72-822519899748" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-dd5cf14d-aa00-47bf-8e72-822519899748" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Deleting offline snapshot dd5cf14d-aa00-47bf-8e72-822519899748 of volume 4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] snapshot_file for this snap is: volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1b9d73-4cbb-429b-98d0-ea268c8e9ce3]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:08 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748
Apr 15 14:43:08 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:08 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4870c581-b5fd-484c-91db-e2a0b1b91455(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c89281-5ef8-4d3d-b8cd-daa76e0ba465]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:08 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455
Apr 15 14:43:08 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:09 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:09 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748
Apr 15 14:43:09 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:09 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748" returned: 0 in 0.456s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:09 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748
Apr 15 14:43:09 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:09 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455.dd5cf14d-aa00-47bf-8e72-822519899748" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-dd5cf14d-aa00-47bf-8e72-822519899748" released by "_delete_snapshot" :: held 1.848s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-4870c581-b5fd-484c-91db-e2a0b1b91455" released by "delete_snapshot" :: held 1.863s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Created reservations ['9a738675-fda3-4781-b8f1-fe08ba0976be', '87bc13e1-0e5b-4fba-bda8-0d102d2c3b8e', '4cac6369-43ac-4b79-baaf-82bd0a5dfc0a', '1b0670d8-cd9b-46a5-bdb4-fa776773bcd7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Delete snapshot completed successfully.
Apr 15 14:43:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-359925fe-a307-486c-ba35-f9ccaa7ea250 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-dd5cf14d-aa00-47bf-8e72-822519899748-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-4870c581-b5fd-484c-91db-e2a0b1b91455-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-4870c581-b5fd-484c-91db-e2a0b1b91455-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-quobyte-4870c581-b5fd-484c-91db-e2a0b1b91455" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-4870c581-b5fd-484c-91db-e2a0b1b91455" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccde4b7-ecbc-4fff-9763-10612563dfec]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:10 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455
Apr 15 14:43:10 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:10 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455" returned: 0 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:10 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455
Apr 15 14:43:10 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:11 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-4870c581-b5fd-484c-91db-e2a0b1b91455" returned: 0 in 0.400s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-4870c581-b5fd-484c-91db-e2a0b1b91455" released by "delete_volume" :: held 0.885s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Created reservations ['5ff346b3-72e9-46be-87ff-97c2900dd9f6', '13d4910f-f82b-4795-a8f7-fd253f808c8f', '874be9da-9e9f-453f-a438-6dba76c72ed6', 'ca4ea26c-c5ad-45ef-b663-ddf20e99d983'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:11 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:11 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "cinder-quobyte-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7413c2e-ebc0-4c9d-bf70-aca588dbe91a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:11 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1
Apr 15 14:43:11 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:11 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Deleted volume successfully.
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99f4db56-2da9-42d1-80ef-3697a6a48d7b tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-4870c581-b5fd-484c-91db-e2a0b1b91455-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:11 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:11 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1
Apr 15 14:43:11 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:12 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1" returned: 0 in 0.395s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-quobyte-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1" released by "delete_volume" :: held 0.889s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Created reservations ['ca809e05-a454-4e71-9683-c82d6897aad7', '69e9ba6a-f0fd-40da-b86e-6a616e0fcc51', '7b9cfeb3-05c0-4a3a-92c5-a1fcf609e395', 'e7152710-0ec5-4759-968a-f510242dcd34'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:12 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:12 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:12 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Deleted volume successfully.
Apr 15 14:43:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2ee5c17f-0f97-46ce-b4d5-6856eacbafa0 tempest-CinderUnicodeTest-2125188418 None] Lock "cinder-2e8f83e8-b799-47ec-b49f-d3d5d27d59f1-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (cdfdf6c9-bda7-4e39-8be5-2db4e63130b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9493355-60e7-48b3-859c-5c4525425c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9493355-60e7-48b3-859c-5c4525425c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-35402630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f382c-bac9-4646-8fc3-2a0831898dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1c88ba68a04c5780364eeb516a3bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:19Z,use_quota=True,user_id='5b42383891784538bfd007e12e094b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274c5357-d305-4f6c-a44c-8e60edd32d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274c5357-d305-4f6c-a44c-8e60edd32d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6bee47-120b-45bf-8294-10637476b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6bee47-120b-45bf-8294-10637476b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82f382c-bac9-4646-8fc3-2a0831898dd2', 'volume_name': 'volume-b82f382c-bac9-4646-8fc3-2a0831898dd2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f8226-b7cf-4ee9-b7ba-b14633e3e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f8226-b7cf-4ee9-b7ba-b14633e3e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877e0805-e6bb-41bc-bc80-d183a199cddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Volume b82f382c-bac9-4646-8fc3-2a0831898dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82f382c-bac9-4646-8fc3-2a0831898dd2', 'volume_size': 1}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-35402630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f382c-bac9-4646-8fc3-2a0831898dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1c88ba68a04c5780364eeb516a3bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:19Z,use_quota=True,user_id='5b42383891784538bfd007e12e094b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Creating volume b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:19 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:19 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 1073741824
Apr 15 14:43:19 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (f3edfc1f-3029-45ab-a97d-f5d14de047ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21d4480-2fda-421e-8a16-9c8f284937e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21d4480-2fda-421e-8a16-9c8f284937e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685494977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69915cdb-2c6d-42fd-91ff-fbd9f1adf66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:19Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7103470e-06b8-4d0c-90aa-d2fa2824059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7103470e-06b8-4d0c-90aa-d2fa2824059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9424daee-aadd-45d1-a3a3-068ba2a03a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9424daee-aadd-45d1-a3a3-068ba2a03a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69915cdb-2c6d-42fd-91ff-fbd9f1adf66b', 'volume_name': 'volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d86b9ab-465d-4606-923c-75a3e2be3aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d86b9ab-465d-4606-923c-75a3e2be3aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9426a5-61b8-4128-8c75-6667a76fe573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume 69915cdb-2c6d-42fd-91ff-fbd9f1adf66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b', 'volume_size': 1}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (8d42c15d-6bab-47ce-84c7-03919af4b964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee8ae9-1e3a-432d-a271-a9a785f696d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee8ae9-1e3a-432d-a271-a9a785f696d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1154278683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e17d1f9-8eba-43ed-a84e-3014b28c33bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0161aa-a5e9-427e-88ce-716a812c2e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0161aa-a5e9-427e-88ce-716a812c2e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4acf08d-99f2-401f-bd9f-79005a1c94d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4acf08d-99f2-401f-bd9f-79005a1c94d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e17d1f9-8eba-43ed-a84e-3014b28c33bd', 'volume_name': 'volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8deaa41e-962f-49e0-8d57-a552ba9074e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8deaa41e-962f-49e0-8d57-a552ba9074e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088a26c2-d1e9-4b9f-8132-24b657aac027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Volume 0e17d1f9-8eba-43ed-a84e-3014b28c33bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd', 'volume_size': 1}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (b414f746-64d9-4534-8ffc-ad437117c3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e1b906-5626-4c99-b1ee-41d61bef981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e1b906-5626-4c99-b1ee-41d61bef981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458988682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c58ed8-12bc-4b4e-af6d-ae2179cefe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2808e1-d761-45db-af23-149fdacbfef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2808e1-d761-45db-af23-149fdacbfef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7ec9e8-ac7e-4b6f-aab0-954fa7806e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7ec9e8-ac7e-4b6f-aab0-954fa7806e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c58ed8-12bc-4b4e-af6d-ae2179cefe7a', 'volume_name': 'volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c42995-e2cb-4a09-ab54-af1208f3df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c42995-e2cb-4a09-ab54-af1208f3df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27193e1f-4171-4b7f-a3f0-ea07342da870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Volume 72c58ed8-12bc-4b4e-af6d-ae2179cefe7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a', 'volume_size': 1}
Apr 15 14:43:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:20 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 1073741824" returned: 0 in 0.645s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:20 devstack sudo[90803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:20 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (d1c25bdd-5f65-47af-b00d-cb13c96994fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d384de-fb04-4fa0-8908-ad54a804eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d384de-fb04-4fa0-8908-ad54a804eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264590860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9159ff-bb2d-4e79-9224-53ad89e90b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b14a168-6744-4b8a-ab73-78b4d6909571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b14a168-6744-4b8a-ab73-78b4d6909571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e423ef1-ada3-48af-a7bb-afafb547c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e423ef1-ada3-48af-a7bb-afafb547c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9159ff-bb2d-4e79-9224-53ad89e90b71', 'volume_name': 'volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3f0350-c2dc-4618-8366-f1763fce29ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3f0350-c2dc-4618-8366-f1763fce29ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66810f68-8aa5-4056-9b2c-7739f49a06e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Volume cd9159ff-bb2d-4e79-9224-53ad89e90b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71', 'volume_size': 1}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (d50fd43a-a64a-46ae-a185-527e93fe6952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b4bfdc-ab52-49a8-8f4f-06c311b5e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b4bfdc-ab52-49a8-8f4f-06c311b5e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-251420556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842a9248-3d14-4927-89f2-112c0346d207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86741f92-d79c-495d-8ed4-ae2fc52b06a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86741f92-d79c-495d-8ed4-ae2fc52b06a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029a2fdc-af6d-4418-a793-5e6c0865fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029a2fdc-af6d-4418-a793-5e6c0865fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842a9248-3d14-4927-89f2-112c0346d207', 'volume_name': 'volume-842a9248-3d14-4927-89f2-112c0346d207', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3f435b-f8ab-4c83-a729-bfea090ad26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3f435b-f8ab-4c83-a729-bfea090ad26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd01900-1cd0-497b-b51a-240b4e908562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Volume 842a9248-3d14-4927-89f2-112c0346d207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842a9248-3d14-4927-89f2-112c0346d207', 'volume_size': 1}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:20 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.493s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685494977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69915cdb-2c6d-42fd-91ff-fbd9f1adf66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:19Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating volume 69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:20 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877e0805-e6bb-41bc-bc80-d183a199cddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82f382c-bac9-4646-8fc3-2a0831898dd2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b 1073741824
Apr 15 14:43:20 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2254a29-37af-418c-8bf6-0b8fb5a8d843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (24b495c4-a8e2-4d7e-8898-c3e2ddad0357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922a6b97-568d-4905-9623-27e2598179f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Volume volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 (b82f382c-bac9-4646-8fc3-2a0831898dd2): created successfully
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2254a29-37af-418c-8bf6-0b8fb5a8d843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (cdfdf6c9-bda7-4e39-8be5-2db4e63130b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922a6b97-568d-4905-9623-27e2598179f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184433728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928caba7-ced7-43e7-a785-c79aa670cffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:21Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b409f3c8-cc97-4259-8edd-c8bba4d9732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b409f3c8-cc97-4259-8edd-c8bba4d9732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89959779-2d73-4dee-aae0-e2dc2437da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89959779-2d73-4dee-aae0-e2dc2437da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928caba7-ced7-43e7-a785-c79aa670cffb', 'volume_name': 'volume-928caba7-ced7-43e7-a785-c79aa670cffb', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b32020d-20ef-4445-b095-5820e0e3d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b32020d-20ef-4445-b095-5820e0e3d06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782ae4a5-824c-4d57-b871-c700e51e07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Volume 928caba7-ced7-43e7-a785-c79aa670cffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928caba7-ced7-43e7-a785-c79aa670cffb', 'volume_size': 1}
Apr 15 14:43:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-367bf27f-3d89-498c-837c-aff55de0ae75 tempest-VolumeDependencyTests-130649381 None] Created volume successfully.
Apr 15 14:43:21 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b 1073741824" returned: 0 in 0.526s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:21 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b
Apr 15 14:43:21 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:21 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1154278683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e17d1f9-8eba-43ed-a84e-3014b28c33bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Creating volume 0e17d1f9-8eba-43ed-a84e-3014b28c33bd {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9426a5-61b8-4128-8c75-6667a76fe573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61555b0b-6f69-48d8-a5fc-5b5902050d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:21 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd 1073741824
Apr 15 14:43:21 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b (69915cdb-2c6d-42fd-91ff-fbd9f1adf66b): created successfully
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61555b0b-6f69-48d8-a5fc-5b5902050d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (f3edfc1f-3029-45ab-a97d-f5d14de047ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-396f7cac-522f-46e3-91a7-8a9a8ea2eca5 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created volume successfully.
Apr 15 14:43:22 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd 1073741824" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:22 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd
Apr 15 14:43:22 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:22 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.681s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458988682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c58ed8-12bc-4b4e-af6d-ae2179cefe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Creating volume 72c58ed8-12bc-4b4e-af6d-ae2179cefe7a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:22 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088a26c2-d1e9-4b9f-8132-24b657aac027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9e106b-e342-466e-91a3-a618d38f935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:22 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a 1073741824
Apr 15 14:43:22 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Volume volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd (0e17d1f9-8eba-43ed-a84e-3014b28c33bd): created successfully
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9e106b-e342-466e-91a3-a618d38f935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (8d42c15d-6bab-47ce-84c7-03919af4b964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b1ef732c-b171-425b-b52b-358de9790415 tempest-CreateVolumesFromImageTest-1560056115 None] Created volume successfully.
Apr 15 14:43:23 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a 1073741824" returned: 0 in 0.608s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:23 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a
Apr 15 14:43:23 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:23 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a" returned: 0 in 0.504s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.622s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264590860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9159ff-bb2d-4e79-9224-53ad89e90b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Creating volume cd9159ff-bb2d-4e79-9224-53ad89e90b71 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:23 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27193e1f-4171-4b7f-a3f0-ea07342da870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf3407f-4fd3-40fd-a059-39c73d8b526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:23 devstack sudo[90832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 1073741824
Apr 15 14:43:23 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Volume volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a (72c58ed8-12bc-4b4e-af6d-ae2179cefe7a): created successfully
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf3407f-4fd3-40fd-a059-39c73d8b526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (b414f746-64d9-4534-8ffc-ad437117c3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-07b82ce2-2367-4e1b-b9ea-7f899e0ee13d tempest-CreateVolumesFromImageTest-1560056115 None] Created volume successfully.
Apr 15 14:43:24 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 1073741824" returned: 0 in 0.615s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:24 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71
Apr 15 14:43:24 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:24 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.504s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-251420556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842a9248-3d14-4927-89f2-112c0346d207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:20Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Creating volume 842a9248-3d14-4927-89f2-112c0346d207 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:25 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66810f68-8aa5-4056-9b2c-7739f49a06e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ddb056-a85d-467d-a6ba-91fd60d27732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:25 devstack sudo[90840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207 1073741824
Apr 15 14:43:25 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Volume volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 (cd9159ff-bb2d-4e79-9224-53ad89e90b71): created successfully
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ddb056-a85d-467d-a6ba-91fd60d27732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (d1c25bdd-5f65-47af-b00d-cb13c96994fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4457ac31-8fe8-49e7-9138-6367daadcc23 tempest-CreateVolumesFromImageTest-1560056115 None] Created volume successfully.
Apr 15 14:43:25 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207 1073741824" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:25 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207
Apr 15 14:43:25 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:25 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184433728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928caba7-ced7-43e7-a785-c79aa670cffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5fafa7c38c4b6196f7815b08d3e6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:21Z,use_quota=True,user_id='459a2b7c23d2454594898086cd5b8374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Creating volume 928caba7-ced7-43e7-a785-c79aa670cffb {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd01900-1cd0-497b-b51a-240b4e908562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842a9248-3d14-4927-89f2-112c0346d207', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85b24fc-bc8e-4017-b9a3-7ad77cc65b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:26 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb 1073741824
Apr 15 14:43:26 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Volume volume-842a9248-3d14-4927-89f2-112c0346d207 (842a9248-3d14-4927-89f2-112c0346d207): created successfully
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85b24fc-bc8e-4017-b9a3-7ad77cc65b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (d50fd43a-a64a-46ae-a185-527e93fe6952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ed51bdfa-d2af-40cb-8578-2d9e6624bbb3 tempest-CreateVolumesFromImageTest-1560056115 None] Created volume successfully.
Apr 15 14:43:26 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb 1073741824" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:26 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb
Apr 15 14:43:26 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:27 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb" returned: 0 in 0.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.428s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782ae4a5-824c-4d57-b871-c700e51e07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928caba7-ced7-43e7-a785-c79aa670cffb', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c6fc38-3bbe-46f9-8004-b906343c071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Creating offline snapshot 78625111-e14b-43e4-b974-b5e331ab298c of volume b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:43:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Volume volume-928caba7-ced7-43e7-a785-c79aa670cffb (928caba7-ced7-43e7-a785-c79aa670cffb): created successfully
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c6fc38-3bbe-46f9-8004-b906343c071b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Flow 'volume_create_manager' (24b495c4-a8e2-4d7e-8898-c3e2ddad0357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce37fd72-7f1b-4e47-9c1d-9612dba743f4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d59d4d5a-ba06-4f63-b4ad-5190611a5128 tempest-CreateVolumesFromImageTest-1560056115 None] Created volume successfully.
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-928caba7-ced7-43e7-a785-c79aa670cffb-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:27 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-928caba7-ced7-43e7-a785-c79aa670cffb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:27 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-quobyte-928caba7-ced7-43e7-a785-c79aa670cffb" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-928caba7-ced7-43e7-a785-c79aa670cffb" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0798cd-b41f-49b2-8866-ecd0077c9327]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:27 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb
Apr 15 14:43:27 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:27 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:27 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c 1G
Apr 15 14:43:27 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:27 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb" returned: 0 in 0.542s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:27 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb
Apr 15 14:43:27 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:28 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c 1G" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:28 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c
Apr 15 14:43:28 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:28 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-928caba7-ced7-43e7-a785-c79aa670cffb" returned: 0 in 0.457s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-928caba7-ced7-43e7-a785-c79aa670cffb" released by "delete_volume" :: held 1.024s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Created reservations ['8a943e2d-f538-466d-b73e-97cea8d8bbcb', '12b7049b-f971-48cd-9d4c-045694daa4fc', 'e678ce44-da50-4528-964d-07ef19dce68e', 'e88156cc-9cc8-49f4-a0a7-816f756f0582'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:28 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:28 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:28 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:28 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c is being set with open permissions: ugo+rw
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:28 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c
Apr 15 14:43:28 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:28 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Deleted volume successfully.
Apr 15 14:43:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e670498-9d88-48e7-a727-032520e40f6e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-928caba7-ced7-43e7-a785-c79aa670cffb-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:29 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c" returned: 0 in 0.531s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:29 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info
Apr 15 14:43:29 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-842a9248-3d14-4927-89f2-112c0346d207-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-842a9248-3d14-4927-89f2-112c0346d207-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-quobyte-842a9248-3d14-4927-89f2-112c0346d207" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-842a9248-3d14-4927-89f2-112c0346d207" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139ec7a-eacd-42d2-87fa-6a42c0572087]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:29 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207
Apr 15 14:43:29 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:29 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info" returned: 0 in 0.476s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:29 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info is being set with open permissions: ugo+rw
Apr 15 14:43:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:29 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info
Apr 15 14:43:29 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:30 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207" returned: 0 in 0.580s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:30 devstack sudo[90896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207
Apr 15 14:43:30 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:30 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.info" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.258s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.518s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating offline snapshot 98dca458-fcd7-4141-9424-d5ef1e188a7c of volume 69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:43:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-279caa9e-c392-4038-b581-2c224524010e tempest-VolumeDependencyTests-130649381 None] Create snapshot completed successfully
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[99945a27-2c80-4ead-b4d0-7746d92f7ba7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:30 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b
Apr 15 14:43:30 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:30 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-842a9248-3d14-4927-89f2-112c0346d207" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-842a9248-3d14-4927-89f2-112c0346d207" released by "delete_volume" :: held 1.122s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Created reservations ['3ed14116-13e8-4da9-9de6-63823ad16ce7', 'bdc57cf0-5d27-4ae8-b079-da88f60772a6', '797cc2ba-527d-4da4-8f56-0f0f67712b5d', '96c67135-b89c-43a8-9649-e5f3ac7332c9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:30 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:30 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:31 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" returned: 0 in 0.693s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:31 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c 1G
Apr 15 14:43:31 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:31 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Deleted volume successfully.
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3ef48a1d-eef6-4613-8d28-7484afc1df9d tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-842a9248-3d14-4927-89f2-112c0346d207-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (553315de-29a5-44b1-b061-65755dec0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec81542-f652-45dd-ac22-6e0dee953b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec81542-f652-45dd-ac22-6e0dee953b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1413210680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eccc09-7bc2-4bc9-96c8-55e72ab80c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1c88ba68a04c5780364eeb516a3bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78625111-e14b-43e4-b974-b5e331ab298c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:31Z,use_quota=True,user_id='5b42383891784538bfd007e12e094b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8111fd63-9569-48f3-88c6-05be75ea104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8111fd63-9569-48f3-88c6-05be75ea104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601245cf-85ed-4917-9a63-21eea323eebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601245cf-85ed-4917-9a63-21eea323eebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94eccc09-7bc2-4bc9-96c8-55e72ab80c48', 'volume_name': 'volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48', 'volume_size': 1, 'snapshot_id': '78625111-e14b-43e4-b974-b5e331ab298c'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec15ab71-c140-4dc4-9bfa-47cb96c2f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec15ab71-c140-4dc4-9bfa-47cb96c2f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e20b34-81ae-411f-af5e-d34c95593eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Volume 94eccc09-7bc2-4bc9-96c8-55e72ab80c48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48', 'volume_size': 1, 'snapshot_id': '78625111-e14b-43e4-b974-b5e331ab298c'}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:31 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c 1G" returned: 0 in 0.604s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:31 devstack sudo[90913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c
Apr 15 14:43:31 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-cd9159ff-bb2d-4e79-9224-53ad89e90b71-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-cd9159ff-bb2d-4e79-9224-53ad89e90b71-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-quobyte-cd9159ff-bb2d-4e79-9224-53ad89e90b71" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-cd9159ff-bb2d-4e79-9224-53ad89e90b71" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5bd4a3-4ce0-4a14-bc8b-44f7e2078a56]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:31 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71
Apr 15 14:43:31 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:32 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:32 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c is being set with open permissions: ugo+rw
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:32 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c
Apr 15 14:43:32 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:32 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71" returned: 0 in 0.707s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:32 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71
Apr 15 14:43:32 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:32 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c" returned: 0 in 0.524s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:32 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info
Apr 15 14:43:32 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:32 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Flow 'volume_create_manager' (73c8ea84-6743-42f7-9063-3088c6f6dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575b95b2-9a96-4586-acb3-e8f8e2d13947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cd9159ff-bb2d-4e79-9224-53ad89e90b71" returned: 0 in 0.537s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575b95b2-9a96-4586-acb3-e8f8e2d13947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-872713067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5625dea3-7454-4ea4-b53c-32a99b9455c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c681b63006064eb7923e15c819b30096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:33Z,use_quota=True,user_id='d24bd377d3cb4220a437f5151e9736a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c020477-e9d5-4dab-8328-06481805af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c020477-e9d5-4dab-8328-06481805af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2933da3a-52a5-456f-95b9-b24fc5627b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2933da3a-52a5-456f-95b9-b24fc5627b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5625dea3-7454-4ea4-b53c-32a99b9455c1', 'volume_name': 'volume-5625dea3-7454-4ea4-b53c-32a99b9455c1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f77ba7f-d3a8-4704-91a0-0aca2f909bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f77ba7f-d3a8-4704-91a0-0aca2f909bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea406a55-0ecc-4f5a-8767-23ab2b78c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Volume 5625dea3-7454-4ea4-b53c-32a99b9455c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5625dea3-7454-4ea4-b53c-32a99b9455c1', 'volume_size': 1}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-cd9159ff-bb2d-4e79-9224-53ad89e90b71" released by "delete_volume" :: held 1.319s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Created reservations ['3e5d8337-317a-4644-984a-f67d118a2b75', '7ac1108d-5b62-45dc-9b77-f997e2048dfc', '289ec679-7b88-41b9-9a0d-132356ae57fc', '9377e543-6c22-417a-8c68-8c7973924420'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:33 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:33 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:33 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:33 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info is being set with open permissions: ugo+rw
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:33 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info
Apr 15 14:43:33 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:33 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.417s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Deleted volume successfully.
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-317ed337-b3d7-400a-a1d3-82544677c201 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-cd9159ff-bb2d-4e79-9224-53ad89e90b71-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:33 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.info" returned: 0 in 0.416s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.109s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-78625111-e14b-43e4-b974-b5e331ab298c-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-78625111-e14b-43e4-b974-b5e331ab298c-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Creating volume 94eccc09-7bc2-4bc9-96c8-55e72ab80c48 from snapshot 78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-564b393b-d7a6-498b-9114-fb8fd75d0a49 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Create snapshot completed successfully
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] snapshot: 78625111-e14b-43e4-b974-b5e331ab298c, volume: 94eccc09-7bc2-4bc9-96c8-55e72ab80c48,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383723f-24a7-45ba-b042-5e20ec226af1]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:33 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c
Apr 15 14:43:33 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-quobyte-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff6785b-766e-4f89-a10f-9a144542ae66]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:34 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a
Apr 15 14:43:34 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:34 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f382c-bac9-4646-8fc3-2a0831898dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c694b-4f70-46e4-a11d-f31e168933a1]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:34 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:34 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (6a42979a-3fd2-47bb-9844-b850b65562bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021955e-078e-4dac-9493-b98d152d3fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021955e-078e-4dac-9493-b98d152d3fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167446005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8203174-80ac-428c-86ca-589508b50efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:34Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dfbe96-4f75-428d-8d80-3d299a839964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dfbe96-4f75-428d-8d80-3d299a839964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef80c175-7c9a-4ad7-af09-a126d43049d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef80c175-7c9a-4ad7-af09-a126d43049d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8203174-80ac-428c-86ca-589508b50efd', 'volume_name': 'volume-c8203174-80ac-428c-86ca-589508b50efd', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af86ff0d-ed90-4784-bb4b-39dc97b89638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af86ff0d-ed90-4784-bb4b-39dc97b89638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0b51dd-9605-4502-a3bc-302571b2ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume c8203174-80ac-428c-86ca-589508b50efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8203174-80ac-428c-86ca-589508b50efd', 'volume_size': 1}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:34 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a
Apr 15 14:43:34 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (23b9a81d-4f3e-40b7-b720-22131d6715f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bb9c78-08d4-4da1-ba26-5b43119a48bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bb9c78-08d4-4da1-ba26-5b43119a48bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167767740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410084fd-eefc-4863-b1d8-f9bd1107ea9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8918a3d-f845-4e60-b2ef-b1f4c7aa90dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8918a3d-f845-4e60-b2ef-b1f4c7aa90dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c7495e-dfc8-4e59-a7dd-a1669b44e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c7495e-dfc8-4e59-a7dd-a1669b44e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410084fd-eefc-4863-b1d8-f9bd1107ea9d', 'volume_name': 'volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63401e95-f8aa-42df-b8fe-30d6c85fc450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63401e95-f8aa-42df-b8fe-30d6c85fc450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae3b639-580e-447d-a0d2-9d8dd909f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume 410084fd-eefc-4863-b1d8-f9bd1107ea9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d', 'volume_size': 1}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:34 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48
Apr 15 14:43:34 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (1f09960a-a512-4c1a-8da8-27b966ef0c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74057913-6e52-4bb3-bc14-b54e46ec8510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74057913-6e52-4bb3-bc14-b54e46ec8510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1119032720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20aa450d-de06-472d-af81-34842eb5e8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eea2937-4b0c-46bd-9ca7-71979d8c94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eea2937-4b0c-46bd-9ca7-71979d8c94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae9ab98-efee-485e-9512-b0ad221bc629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae9ab98-efee-485e-9512-b0ad221bc629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20aa450d-de06-472d-af81-34842eb5e8f1', 'volume_name': 'volume-20aa450d-de06-472d-af81-34842eb5e8f1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd171c6-f63a-45de-833a-f43a08227daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd171c6-f63a-45de-833a-f43a08227daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53f2530-1383-4ec7-ac8b-b8bc5f818831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:34 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume 20aa450d-de06-472d-af81-34842eb5e8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20aa450d-de06-472d-af81-34842eb5e8f1', 'volume_size': 1}
Apr 15 14:43:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:35 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a" released by "delete_volume" :: held 1.128s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (d3110f3f-5a16-43a4-ae44-3f36dbf70c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7826a6e3-8b7e-4d0f-a151-79537111f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7826a6e3-8b7e-4d0f-a151-79537111f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133607546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea858948-f667-487d-a098-3743a2ded539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea858948-f667-487d-a098-3743a2ded539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a382aef9-6893-489b-8bc7-016412c77b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a382aef9-6893-489b-8bc7-016412c77b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b', 'volume_name': 'volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f2f7fc-2514-4602-bf66-2658d4418de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f2f7fc-2514-4602-bf66-2658d4418de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01eb060-05fa-40de-994a-21239ad1cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b', 'volume_size': 1}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Created reservations ['24609a9a-e917-4e4a-aa56-025f1e3912cc', 'e4f8f4f1-eefe-46c2-a73f-51ffa121895c', '59185dc0-5529-4549-a359-4a0d68253110', 'd5e2547b-b357-4569-965c-b0952185878e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:35 devstack sudo[90968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:35 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (67fe4778-60f9-4eba-9e10-7fd110116633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5751d8be-a03f-48b6-b9ee-8554d77d0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5751d8be-a03f-48b6-b9ee-8554d77d0216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477978395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e76a7ec-9860-4ccb-b19d-f75040b3f597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e76a7ec-9860-4ccb-b19d-f75040b3f597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f6245f-9ba1-47f4-9d72-5966011ed30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f6245f-9ba1-47f4-9d72-5966011ed30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc', 'volume_name': 'volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9095b26-039c-4be4-890f-ac8c79fc814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9095b26-039c-4be4-890f-ac8c79fc814b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039a23d7-bbdf-4a97-815d-354d1104ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:35 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc', 'volume_size': 1}
Apr 15 14:43:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-0e17d1f9-8eba-43ed-a84e-3014b28c33bd-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-0e17d1f9-8eba-43ed-a84e-3014b28c33bd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "cinder-quobyte-0e17d1f9-8eba-43ed-a84e-3014b28c33bd" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-0e17d1f9-8eba-43ed-a84e-3014b28c33bd" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeb2d90-ee27-448a-a7a1-7fecce2d6952]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:36 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 1.239s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Deleted volume successfully.
Apr 15 14:43:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5a621ced-dda9-4842-8d4e-e875feb6c9b0 tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-72c58ed8-12bc-4b4e-af6d-ae2179cefe7a-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:36 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd
Apr 15 14:43:36 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:37 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" returned: 0 in 2.291s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd18cc1-ecf8-47ed-93dc-97b0899351f9]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:37 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:37 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:37 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd" returned: 0 in 0.793s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:37 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd
Apr 15 14:43:37 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:37 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.619s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:43:37 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Converted 1024.00 MB image at 446.57 MB/s
Apr 15 14:43:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 is being set with open permissions: ugo+rw
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:37 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48
Apr 15 14:43:37 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:37 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-0e17d1f9-8eba-43ed-a84e-3014b28c33bd" returned: 0 in 0.430s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-quobyte-0e17d1f9-8eba-43ed-a84e-3014b28c33bd" released by "delete_volume" :: held 1.313s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Created reservations ['accd0959-8e96-465c-87df-2224a8ae459c', '2654d475-e46c-4ba1-864b-931bd8338e3b', 'a57511a9-fc8c-4a56-b897-6e7386b4dc0a', '9521a530-1dfa-44aa-93a6-a3c00136ccfe'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:37 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:37 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:38 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" returned: 0 in 0.414s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" released by "_copy_volume_from_snapshot" :: held 4.387s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-78625111-e14b-43e4-b974-b5e331ab298c-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" released by "_create_volume_from_snapshot" :: held 4.406s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.423s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.049s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-872713067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5625dea3-7454-4ea4-b53c-32a99b9455c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c681b63006064eb7923e15c819b30096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:33Z,use_quota=True,user_id='d24bd377d3cb4220a437f5151e9736a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Creating volume 5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:38 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:38 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 1073741824
Apr 15 14:43:38 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e20b34-81ae-411f-af5e-d34c95593eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48', 'volume_size': 1, 'snapshot_id': '78625111-e14b-43e4-b974-b5e331ab298c'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725e1cc0-3237-41cd-b8b3-4950a231e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Volume volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 (94eccc09-7bc2-4bc9-96c8-55e72ab80c48): created successfully
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725e1cc0-3237-41cd-b8b3-4950a231e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (553315de-29a5-44b1-b061-65755dec0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aec5409e-7def-4c7a-b710-19ce36e346c9 tempest-VolumeDependencyTests-130649381 None] Created volume successfully.
Apr 15 14:43:38 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.440s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Deleted volume successfully.
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d08d96af-2829-4fb9-8c76-a7cc06b9bb4e tempest-CreateVolumesFromImageTest-1560056115 None] Lock "cinder-0e17d1f9-8eba-43ed-a84e-3014b28c33bd-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:38 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 1073741824" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:38 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:43:38 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-78625111-e14b-43e4-b974-b5e331ab298c-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Lock "cinder-78625111-e14b-43e4-b974-b5e331ab298c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-b82f382c-bac9-4646-8fc3-2a0831898dd2" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-b82f382c-bac9-4646-8fc3-2a0831898dd2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-78625111-e14b-43e4-b974-b5e331ab298c" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-78625111-e14b-43e4-b974-b5e331ab298c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Deleting offline snapshot 78625111-e14b-43e4-b974-b5e331ab298c of volume b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] snapshot_file for this snap is: volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e4a72c-f9ca-4200-946e-885ed4e4260f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:39 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.688s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167446005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8203174-80ac-428c-86ca-589508b50efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:34Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating volume c8203174-80ac-428c-86ca-589508b50efd {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:39 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea406a55-0ecc-4f5a-8767-23ab2b78c839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5625dea3-7454-4ea4-b53c-32a99b9455c1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:39 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c
Apr 15 14:43:39 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e88a8b-3b4a-4dbf-a6d4-36481ab51724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:39 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd 1073741824
Apr 15 14:43:39 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Volume volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 (5625dea3-7454-4ea4-b53c-32a99b9455c1): created successfully
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e88a8b-3b4a-4dbf-a6d4-36481ab51724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Flow 'volume_create_manager' (73c8ea84-6743-42f7-9063-3088c6f6dd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-564a1a99-24de-40a9-b34c-fc8970a1c155 tempest-SnapshotDependencyTests-1826917876 None] Created volume successfully.
Apr 15 14:43:39 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c" returned: 0 in 0.595s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f382c-bac9-4646-8fc3-2a0831898dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[747de78d-dc75-43a0-af89-6ea48994ca39]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:39 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd 1073741824" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:39 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:39 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:39 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd
Apr 15 14:43:39 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:40 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.523s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:40 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c
Apr 15 14:43:40 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:40 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.599s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167767740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410084fd-eefc-4863-b1d8-f9bd1107ea9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating volume 410084fd-eefc-4863-b1d8-f9bd1107ea9d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:40 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0b51dd-9605-4502-a3bc-302571b2ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8203174-80ac-428c-86ca-589508b50efd', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf46c44a-3e12-422b-98ff-57a04999ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:40 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d 1073741824
Apr 15 14:43:40 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume volume-c8203174-80ac-428c-86ca-589508b50efd (c8203174-80ac-428c-86ca-589508b50efd): created successfully
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf46c44a-3e12-422b-98ff-57a04999ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (6a42979a-3fd2-47bb-9844-b850b65562bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f9837c6e-db7c-4cec-bb43-6059e8c072a8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created volume successfully.
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (019a9eec-f66e-448e-8996-0f52d8eea0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7782ac8-2a66-48cd-91e3-3ddde5acb984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7782ac8-2a66-48cd-91e3-3ddde5acb984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952386365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738bd018-8abd-4a67-aba9-ab0d0e7d3e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:41Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d231b7-c6da-406d-b79b-2537ae7937a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d231b7-c6da-406d-b79b-2537ae7937a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ed357e-5a4b-42eb-9f42-d4a663d98874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ed357e-5a4b-42eb-9f42-d4a663d98874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738bd018-8abd-4a67-aba9-ab0d0e7d3e9c', 'volume_name': 'volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a17a3c-a466-450d-9606-1d508d176387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a17a3c-a466-450d-9606-1d508d176387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5a246b-276e-460b-a354-f176486c6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume 738bd018-8abd-4a67-aba9-ab0d0e7d3e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c', 'volume_size': 1}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:40 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:40 devstack sudo[91033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c
Apr 15 14:43:40 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:40 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d 1073741824" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:40 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d
Apr 15 14:43:40 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:41 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2.78625111-e14b-43e4-b974-b5e331ab298c" returned: 0 in 0.415s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-78625111-e14b-43e4-b974-b5e331ab298c" released by "_delete_snapshot" :: held 2.163s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-b82f382c-bac9-4646-8fc3-2a0831898dd2" released by "delete_snapshot" :: held 2.181s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Created reservations ['57980f34-6ab2-495d-9d83-e52e1c814e8b', 'b05a991d-7749-49b8-ab9c-a4ea4b9c3861', 'ab3713d6-9f88-4d5c-bbe0-9c959bf34f1d', 'b5cda691-efaa-4eba-ace5-4ba279e73e37'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Delete snapshot completed successfully.
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-be6f061e-34b6-4e46-a1fc-2d64f30f4e0d tempest-VolumeDependencyTests-130649381 None] Lock "cinder-78625111-e14b-43e4-b974-b5e331ab298c-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:41 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d" returned: 0 in 0.433s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.454s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1119032720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20aa450d-de06-472d-af81-34842eb5e8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating volume 20aa450d-de06-472d-af81-34842eb5e8f1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:41 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae3b639-580e-447d-a0d2-9d8dd909f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:41 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1 1073741824
Apr 15 14:43:41 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccd8eaf-c1fe-42e2-a752-6fa0cb01ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d (410084fd-eefc-4863-b1d8-f9bd1107ea9d): created successfully
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccd8eaf-c1fe-42e2-a752-6fa0cb01ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (23b9a81d-4f3e-40b7-b720-22131d6715f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d2505b8c-ce0d-4cc3-98f4-10daeb3488c8 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created volume successfully.
Apr 15 14:43:41 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1 1073741824" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:41 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1
Apr 15 14:43:41 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-b82f382c-bac9-4646-8fc3-2a0831898dd2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Lock "cinder-b82f382c-bac9-4646-8fc3-2a0831898dd2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-b82f382c-bac9-4646-8fc3-2a0831898dd2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-b82f382c-bac9-4646-8fc3-2a0831898dd2" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[17276fb1-5257-463b-804f-3128476490a8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:42 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1" returned: 0 in 0.419s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.168s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133607546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating volume dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:42 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53f2530-1383-4ec7-ac8b-b8bc5f818831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20aa450d-de06-472d-af81-34842eb5e8f1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:42 devstack sudo[91048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b 1073741824
Apr 15 14:43:42 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0070304-a205-4f10-bef3-66cfaf6d74dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:42 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume volume-20aa450d-de06-472d-af81-34842eb5e8f1 (20aa450d-de06-472d-af81-34842eb5e8f1): created successfully
Apr 15 14:43:42 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:42 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0070304-a205-4f10-bef3-66cfaf6d74dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (1f09960a-a512-4c1a-8da8-27b966ef0c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-017658a8-690b-462d-b69e-446af77abb4b tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created volume successfully.
Apr 15 14:43:42 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:42 devstack sudo[91057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2
Apr 15 14:43:42 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:42 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b 1073741824" returned: 0 in 0.489s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:42 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b
Apr 15 14:43:42 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:43 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b82f382c-bac9-4646-8fc3-2a0831898dd2" returned: 0 in 0.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-b82f382c-bac9-4646-8fc3-2a0831898dd2" released by "delete_volume" :: held 0.953s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=134,cinder:UPDATE=188,cinder:INSERT=44,cinder:DELETE=21 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:43:43 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b" returned: 0 in 0.404s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.519s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477978395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ef5a4487fe48d296e0c2fb211db9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:35Z,use_quota=True,user_id='1526831116914707b67fad70dbb0c5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Creating volume eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:43 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:43 devstack sudo[91063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc 1073741824
Apr 15 14:43:43 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01eb060-05fa-40de-994a-21239ad1cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9cb7a2-28d2-474b-bf6c-091c6ba6a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b (dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b): created successfully
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9cb7a2-28d2-474b-bf6c-091c6ba6a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (d3110f3f-5a16-43a4-ae44-3f36dbf70c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Created reservations ['47088328-c4d3-432f-95bb-95db05148c01', '6c6d5c75-69d4-450c-ac36-ae32ae920c38', '70b3bb2a-71c7-4ca1-a5dc-662db2931f77', '7d38d488-a895-47a0-a6c7-1f7771cef3a0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-323d6242-99c8-4fde-b7ac-d2e8209c0219 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created volume successfully.
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:43 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:43 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:43 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.406s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Deleted volume successfully.
Apr 15 14:43:43 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc 1073741824" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c428e41b-21a4-410d-a53a-d023ff1b597e tempest-VolumeDependencyTests-130649381 None] Lock "cinder-b82f382c-bac9-4646-8fc3-2a0831898dd2-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:43 devstack sudo[91071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc
Apr 15 14:43:43 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:44 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc" returned: 0 in 0.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952386365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738bd018-8abd-4a67-aba9-ab0d0e7d3e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:41Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Creating volume 738bd018-8abd-4a67-aba9-ab0d0e7d3e9c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039a23d7-bbdf-4a97-815d-354d1104ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cbd654-356d-4e32-9b57-a20c5f4987dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:44 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c 1073741824
Apr 15 14:43:44 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Volume volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc (eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc): created successfully
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cbd654-356d-4e32-9b57-a20c5f4987dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Flow 'volume_create_manager' (67fe4778-60f9-4eba-9e10-7fd110116633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a1f3db08-9c8c-4244-b659-36a1428a2d20 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created volume successfully.
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (c26a006b-5464-4313-8d27-fd12c5afad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca18a16-ab7d-4c83-b128-3ccb724ba002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca18a16-ab7d-4c83-b128-3ccb724ba002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2096447491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81ac579-180e-4977-b2af-0bc4333d9431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1c88ba68a04c5780364eeb516a3bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:45Z,use_quota=True,user_id='5b42383891784538bfd007e12e094b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf09b81-0370-417a-a5e7-489ea594ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf09b81-0370-417a-a5e7-489ea594ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958173b2-639e-4a37-ad7c-22bd080b7759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958173b2-639e-4a37-ad7c-22bd080b7759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81ac579-180e-4977-b2af-0bc4333d9431', 'volume_name': 'volume-d81ac579-180e-4977-b2af-0bc4333d9431', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a31dc95-78ac-4f79-a3cb-42e236cf0f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a31dc95-78ac-4f79-a3cb-42e236cf0f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91917d21-3e78-4b2e-991d-f60e5c5e72df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Volume d81ac579-180e-4977-b2af-0bc4333d9431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81ac579-180e-4977-b2af-0bc4333d9431', 'volume_size': 1}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:44 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c 1073741824" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:44 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c
Apr 15 14:43:44 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc" acquired by "delete_volume" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c0684-64b5-4a70-b442-b5c4419f048a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:45 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc
Apr 15 14:43:45 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:45 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c" returned: 0 in 0.443s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.698s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5a246b-276e-460b-a354-f176486c6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a245fd3-ac17-4ea4-bb31-e0483ef6ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Creating offline snapshot 841728f5-1017-4149-bdcf-770a59df2d31 of volume 5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:43:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c (738bd018-8abd-4a67-aba9-ab0d0e7d3e9c): created successfully
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a245fd3-ac17-4ea4-bb31-e0483ef6ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (019a9eec-f66e-448e-8996-0f52d8eea0f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdb9d64-41e9-4a94-ac4a-0564de3fc3c0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7cb46525-facf-4cd9-8149-f410ceff7b4e tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created volume successfully.
Apr 15 14:43:45 devstack sudo[91084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:43:45 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:45 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc" returned: 0 in 0.531s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:45 devstack sudo[91123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc
Apr 15 14:43:45 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:45 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:45 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 1G
Apr 15 14:43:45 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (c9230e24-088b-4da0-bf57-5456508b44e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128691d-7a42-43a5-9c48-3aca4b7d465f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128691d-7a42-43a5-9c48-3aca4b7d465f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1299396990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e36fac-0bcd-4235-ba08-e34c179bd36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:46Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e3138c-70c4-457e-a00c-0e1375582364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e3138c-70c4-457e-a00c-0e1375582364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bb1a78-7141-40b4-b06d-0d1d82e4c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bb1a78-7141-40b4-b06d-0d1d82e4c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e36fac-0bcd-4235-ba08-e34c179bd36c', 'volume_name': 'volume-02e36fac-0bcd-4235-ba08-e34c179bd36c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f333861-1d63-49b9-9571-05cd5ad0d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f333861-1d63-49b9-9571-05cd5ad0d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832176b2-5f95-4e18-b76f-1c14b4b6cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume 02e36fac-0bcd-4235-ba08-e34c179bd36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e36fac-0bcd-4235-ba08-e34c179bd36c', 'volume_size': 1}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:46 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc" released by "delete_volume" :: held 1.064s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (3746fd93-72b9-4681-b0d3-0f7e407c5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df3aaad-9107-45d0-96dd-f635ef7f43c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df3aaad-9107-45d0-96dd-f635ef7f43c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889068427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:46Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b56dcae-3d68-4b9c-a255-610c67cc77e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b56dcae-3d68-4b9c-a255-610c67cc77e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9f42ac-848a-4841-9e56-c386aa31d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9f42ac-848a-4841-9e56-c386aa31d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3', 'volume_name': 'volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249f47dd-962c-4655-bd5e-847fedea5ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249f47dd-962c-4655-bd5e-847fedea5ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf33de8-64c2-4ec9-bed0-df40a442caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume 9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3', 'volume_size': 1}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['ba97ca6c-bc72-4f43-aaad-9a79ec7ef8bf', 'fa509bbc-5b50-41d8-ae70-fad4ff4fc9b4', '656a5c0d-6254-4eed-b7a4-2d8565aa8e61', 'ef3ee403-9fcd-4c1d-bfb3-c62accd0429d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:46 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 1G" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:46 devstack sudo[91134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:46 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:46 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31
Apr 15 14:43:46 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (077231bf-665a-4f6f-bcf6-e2cebf146a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9c966f-10a9-4266-93ae-c816337d0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9c966f-10a9-4266-93ae-c816337d0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1077947340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f12d7f7-04e1-4376-8604-a8ded29df5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:46Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bf4a7e-e536-4b42-a127-18f1b13f332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bf4a7e-e536-4b42-a127-18f1b13f332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5f750f-7a0a-4426-b495-bcde92208385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5f750f-7a0a-4426-b495-bcde92208385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f12d7f7-04e1-4376-8604-a8ded29df5e2', 'volume_name': 'volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82eca4-1a34-401a-bfc1-7c5eb984e78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82eca4-1a34-401a-bfc1-7c5eb984e78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb38e87-4b9e-4844-b13e-8576d76a6bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume 3f12d7f7-04e1-4376-8604-a8ded29df5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2', 'volume_size': 1}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (61f65025-d7ca-4709-9edf-24db4a188917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d837c477-c841-4924-b26b-3df75ac444b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d837c477-c841-4924-b26b-3df75ac444b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210441400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ede3aa-f11f-46b0-98cb-d299b7874798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:47Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3247026-d471-4d2a-9bb9-a6247bd40ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3247026-d471-4d2a-9bb9-a6247bd40ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394cb898-1bda-4ad6-ac6f-db8124cb562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394cb898-1bda-4ad6-ac6f-db8124cb562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ede3aa-f11f-46b0-98cb-d299b7874798', 'volume_name': 'volume-73ede3aa-f11f-46b0-98cb-d299b7874798', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c4d6c5-4b10-43cd-a1df-b429ce4b345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c4d6c5-4b10-43cd-a1df-b429ce4b345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b89871-bc69-43f1-bb22-7b15322b2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume 73ede3aa-f11f-46b0-98cb-d299b7874798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ede3aa-f11f-46b0-98cb-d299b7874798', 'volume_size': 1}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:46 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.449s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleted volume successfully.
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9acbf603-b631-4bdd-a74f-bde43faa63bd tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-eda0d3ee-39fa-4fc3-8536-8cdc11a0adcc-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (767f3a95-4305-4d83-ad68-17f6e72d92ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e7b13a-9736-4947-be59-78e67e21f741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e7b13a-9736-4947-be59-78e67e21f741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1511939654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51a12df-8656-4046-89bd-827534739418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:47Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633d85b1-d53c-4d39-bda8-528516c485e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633d85b1-d53c-4d39-bda8-528516c485e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cb7c93-29d4-446e-a24e-10904dca3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cb7c93-29d4-446e-a24e-10904dca3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51a12df-8656-4046-89bd-827534739418', 'volume_name': 'volume-c51a12df-8656-4046-89bd-827534739418', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274dddb1-d180-4d6e-b172-eb4277f2a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274dddb1-d180-4d6e-b172-eb4277f2a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f0e6e5-c789-4f68-95b8-8e1b1e64d0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume c51a12df-8656-4046-89bd-827534739418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51a12df-8656-4046-89bd-827534739418', 'volume_size': 1}
Apr 15 14:43:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:47 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:47 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 is being set with open permissions: ugo+rw
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:47 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31
Apr 15 14:43:47 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c270e6e3-4604-4754-8827-244ece8e16fb]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:47 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31" returned: 0 in 0.405s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:47 devstack sudo[91145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b
Apr 15 14:43:47 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:47 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info
Apr 15 14:43:47 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:47 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:47 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:47 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info" returned: 0 in 0.439s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:47 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info is being set with open permissions: ugo+rw
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:47 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:47 devstack sudo[91156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info
Apr 15 14:43:47 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:47 devstack sudo[91157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b
Apr 15 14:43:47 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:48 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.465s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cacb1b4-d1ca-4442-95b4-c7bdbbcd318f None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:48 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b" returned: 0 in 0.417s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:48 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.info" returned: 0 in 0.437s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b" released by "delete_volume" :: held 0.967s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.612s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2096447491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81ac579-180e-4977-b2af-0bc4333d9431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1c88ba68a04c5780364eeb516a3bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:45Z,use_quota=True,user_id='5b42383891784538bfd007e12e094b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Creating volume d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:48 devstack sudo[91163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 1073741824
Apr 15 14:43:48 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c2b89795-75b5-4fd9-be91-71066a2cfc78 tempest-SnapshotDependencyTests-1826917876 None] Create snapshot completed successfully
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['2295df07-1792-4d77-bc31-9be14093c79e', '06e26e8f-9cb5-45db-8dd1-3cc7b4a2f4ea', 'd4462757-4b8f-4810-b518-53f984e5be3f', '40adde1b-8d6a-4e4c-9f0b-3b76159ae627'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:48 devstack sudo[91165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:48 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:48 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleted volume successfully.
Apr 15 14:43:48 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9921a7de-618a-4999-b297-3ed96d1fdb98 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-dd1ea485-0dbf-4ccc-8ca8-ef32c18b026b-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 1073741824" returned: 0 in 0.584s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:48 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:43:48 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Flow 'volume_create_manager' (d5466d29-ef96-4ade-a7e5-26c10d335055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220928b0-ba32-4c0f-b18b-a49cf3354382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220928b0-ba32-4c0f-b18b-a49cf3354382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d38382-edf0-41dd-9428-56b983ac5ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c681b63006064eb7923e15c819b30096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=841728f5-1017-4149-bdcf-770a59df2d31,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:49Z,use_quota=True,user_id='d24bd377d3cb4220a437f5151e9736a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e10525-fd6d-45cf-a335-77f6187bf276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e10525-fd6d-45cf-a335-77f6187bf276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301267ec-4fc5-4de7-953c-4e894d392136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301267ec-4fc5-4de7-953c-4e894d392136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83d38382-edf0-41dd-9428-56b983ac5ebe', 'volume_name': 'volume-83d38382-edf0-41dd-9428-56b983ac5ebe', 'volume_size': 1, 'snapshot_id': '841728f5-1017-4149-bdcf-770a59df2d31'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e9544f-3396-460a-bccf-4cabdb5ca80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e9544f-3396-460a-bccf-4cabdb5ca80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3406f45-17d2-44b8-8832-7e53ab626860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Volume 83d38382-edf0-41dd-9428-56b983ac5ebe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83d38382-edf0-41dd-9428-56b983ac5ebe', 'volume_size': 1, 'snapshot_id': '841728f5-1017-4149-bdcf-770a59df2d31'}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:49 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.374s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1299396990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e36fac-0bcd-4235-ba08-e34c179bd36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:46Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Creating volume 02e36fac-0bcd-4235-ba08-e34c179bd36c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:49 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91917d21-3e78-4b2e-991d-f60e5c5e72df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81ac579-180e-4977-b2af-0bc4333d9431', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d909622b-77ba-40d8-aecc-83dc3d195990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:49 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c 1073741824
Apr 15 14:43:49 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Volume volume-d81ac579-180e-4977-b2af-0bc4333d9431 (d81ac579-180e-4977-b2af-0bc4333d9431): created successfully
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d909622b-77ba-40d8-aecc-83dc3d195990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (c26a006b-5464-4313-8d27-fd12c5afad4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-20aa450d-de06-472d-af81-34842eb5e8f1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8df5f6fe-cad5-4120-a1d4-456125eff349 tempest-VolumeDependencyTests-130649381 None] Created volume successfully.
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-20aa450d-de06-472d-af81-34842eb5e8f1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-20aa450d-de06-472d-af81-34842eb5e8f1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-20aa450d-de06-472d-af81-34842eb5e8f1" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e12f39-aeaa-4db1-8e1d-048171454bd1]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:49 devstack sudo[91177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1
Apr 15 14:43:49 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:50 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c 1073741824" returned: 0 in 0.616s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:50 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1" returned: 0 in 0.558s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:50 devstack sudo[91185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c
Apr 15 14:43:50 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:50 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1
Apr 15 14:43:50 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (99203a41-03ea-4bdd-a259-8a474657c292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234fb22-c884-4d6e-87bb-f58ed7047df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234fb22-c884-4d6e-87bb-f58ed7047df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2132224658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf41b2e5-d783-4595-889d-9bb12b0da748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1c88ba68a04c5780364eeb516a3bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d81ac579-180e-4977-b2af-0bc4333d9431,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:50Z,use_quota=True,user_id='5b42383891784538bfd007e12e094b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0c070-ddb6-4a7c-bbd3-21662701ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0c070-ddb6-4a7c-bbd3-21662701ab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6386613b-87c9-477f-815a-3c89fe52af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6386613b-87c9-477f-815a-3c89fe52af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf41b2e5-d783-4595-889d-9bb12b0da748', 'volume_name': 'volume-cf41b2e5-d783-4595-889d-9bb12b0da748', 'volume_size': 1, 'source_volid': 'd81ac579-180e-4977-b2af-0bc4333d9431', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cc2238-baf9-480d-9366-ae455af507ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cc2238-baf9-480d-9366-ae455af507ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac02967-83f7-48ce-a253-b955f4ad5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Volume cf41b2e5-d783-4595-889d-9bb12b0da748: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf41b2e5-d783-4595-889d-9bb12b0da748', 'volume_size': 1, 'source_volid': 'd81ac579-180e-4977-b2af-0bc4333d9431', 'source_volstatus': 'available'}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:50 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-20aa450d-de06-472d-af81-34842eb5e8f1" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-20aa450d-de06-472d-af81-34842eb5e8f1" released by "delete_volume" :: held 1.040s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:50 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.291s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889068427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:46Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Creating volume 9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:50 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['6dddbaff-a4da-4fed-a8bb-bd76e7befad7', 'a0eec070-e8a2-4938-9bd3-e146c3b72680', '97b7d62d-17e0-4e41-a1c7-300a323e5dca', 'e196cd83-d41d-4036-9160-1fd4461ace08'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:50 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 1073741824
Apr 15 14:43:50 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832176b2-5f95-4e18-b76f-1c14b4b6cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e36fac-0bcd-4235-ba08-e34c179bd36c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc86a22-d656-4bc6-ad42-493c5fd14d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume volume-02e36fac-0bcd-4235-ba08-e34c179bd36c (02e36fac-0bcd-4235-ba08-e34c179bd36c): created successfully
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc86a22-d656-4bc6-ad42-493c5fd14d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (c9230e24-088b-4da0-bf57-5456508b44e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b901cb71-b5ee-4306-b890-08119a3c288c tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created volume successfully.
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:50 devstack sudo[91193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:50 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:51 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 1073741824" returned: 0 in 0.514s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:51 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleted volume successfully.
Apr 15 14:43:51 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81527d58-7ffc-43e3-b770-0f9a2fecfdbe tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-20aa450d-de06-472d-af81-34842eb5e8f1-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:51 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:51 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3" returned: 0 in 0.415s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.058s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1077947340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f12d7f7-04e1-4376-8604-a8ded29df5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:46Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Creating volume 3f12d7f7-04e1-4376-8604-a8ded29df5e2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:51 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf33de8-64c2-4ec9-bed0-df40a442caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:51 devstack sudo[91202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 1073741824
Apr 15 14:43:51 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620c8be5-ae04-4b40-81e4-1fd1c872c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:51 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 (9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3): created successfully
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620c8be5-ae04-4b40-81e4-1fd1c872c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (3746fd93-72b9-4681-b0d3-0f7e407c5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f3edfdc4-2926-4e12-9d99-2af577f67fef tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created volume successfully.
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-410084fd-eefc-4863-b1d8-f9bd1107ea9d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-410084fd-eefc-4863-b1d8-f9bd1107ea9d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-410084fd-eefc-4863-b1d8-f9bd1107ea9d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-410084fd-eefc-4863-b1d8-f9bd1107ea9d" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f283f3-d1d6-43dd-927e-b19e2d6fd0ef]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:51 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d
Apr 15 14:43:51 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:52 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 1073741824" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:52 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2
Apr 15 14:43:52 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:52 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d" returned: 0 in 0.522s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:52 devstack sudo[91214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d
Apr 15 14:43:52 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:52 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.808s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210441400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ede3aa-f11f-46b0-98cb-d299b7874798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:47Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Creating volume 73ede3aa-f11f-46b0-98cb-d299b7874798 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:52 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:52 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798 1073741824
Apr 15 14:43:52 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb38e87-4b9e-4844-b13e-8576d76a6bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce092f4-7e2a-4168-bc8f-96dc4adf7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:52 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 (3f12d7f7-04e1-4376-8604-a8ded29df5e2): created successfully
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce092f4-7e2a-4168-bc8f-96dc4adf7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (077231bf-665a-4f6f-bcf6-e2cebf146a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9cb74a09-39d0-416a-a98b-42bcb14bc737 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created volume successfully.
Apr 15 14:43:52 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-410084fd-eefc-4863-b1d8-f9bd1107ea9d" returned: 0 in 0.417s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-410084fd-eefc-4863-b1d8-f9bd1107ea9d" released by "delete_volume" :: held 0.963s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['e1606719-213b-4fbc-b3fb-534b3a97cc3d', '58b148d6-2b44-4a13-ade7-e40523f53583', '2b5b9e29-8dd0-4131-b769-d1a870692af5', 'a1311683-4e25-4d38-8ad4-8dd55848dc6d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:52 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:52 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:53 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798 1073741824" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:53 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798
Apr 15 14:43:53 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:53 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.428s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleted volume successfully.
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a87a97c4-35df-41b0-a098-f132830ea950 tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-410084fd-eefc-4863-b1d8-f9bd1107ea9d-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:53 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798" returned: 0 in 0.441s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.574s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1511939654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51a12df-8656-4046-89bd-827534739418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9fa133411049ffb67d2a101ddf9fd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:43:47Z,use_quota=True,user_id='fe9f39c1ce6642f2ab49c1daf646df64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Creating volume c51a12df-8656-4046-89bd-827534739418 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:53 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b89871-bc69-43f1-bb22-7b15322b2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ede3aa-f11f-46b0-98cb-d299b7874798', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:53 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418 1073741824
Apr 15 14:43:53 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc11ef2-6928-4418-8c73-9d91a044cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume volume-73ede3aa-f11f-46b0-98cb-d299b7874798 (73ede3aa-f11f-46b0-98cb-d299b7874798): created successfully
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc11ef2-6928-4418-8c73-9d91a044cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (61f65025-d7ca-4709-9edf-24db4a188917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a942298c-8f6d-40ff-8f34-81b005d493d8 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created volume successfully.
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-c8203174-80ac-428c-86ca-589508b50efd-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-c8203174-80ac-428c-86ca-589508b50efd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-c8203174-80ac-428c-86ca-589508b50efd" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-c8203174-80ac-428c-86ca-589508b50efd" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944f3dd-166f-4ae0-ad0d-8dcf35ba3963]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:53 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd
Apr 15 14:43:53 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:54 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418 1073741824" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:54 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418
Apr 15 14:43:54 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:54 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd" returned: 0 in 0.526s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:54 devstack sudo[91241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd
Apr 15 14:43:54 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:54 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418" returned: 0 in 0.476s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.275s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-quobyte-841728f5-1017-4149-bdcf-770a59df2d31-83d38382-edf0-41dd-9428-56b983ac5ebe" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f0e6e5-c789-4f68-95b8-8e1b1e64d0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51a12df-8656-4046-89bd-827534739418', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1fd960-e48a-41f2-a2ff-986adeb3bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Volume volume-c51a12df-8656-4046-89bd-827534739418 (c51a12df-8656-4046-89bd-827534739418): created successfully
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1fd960-e48a-41f2-a2ff-986adeb3bb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Flow 'volume_create_manager' (767f3a95-4305-4d83-ad68-17f6e72d92ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-841728f5-1017-4149-bdcf-770a59df2d31-83d38382-edf0-41dd-9428-56b983ac5ebe" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Creating volume 83d38382-edf0-41dd-9428-56b983ac5ebe from snapshot 841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-quobyte-83d38382-edf0-41dd-9428-56b983ac5ebe" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0cf25996-3fef-44a2-b6cc-208ab3cf2ea9 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created volume successfully.
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-83d38382-edf0-41dd-9428-56b983ac5ebe" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] snapshot: 841728f5-1017-4149-bdcf-770a59df2d31, volume: 83d38382-edf0-41dd-9428-56b983ac5ebe,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afae3cb-e357-42cc-a652-0344674ae719]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:54 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31
Apr 15 14:43:54 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:54 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c8203174-80ac-428c-86ca-589508b50efd" returned: 0 in 0.424s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-c8203174-80ac-428c-86ca-589508b50efd" released by "delete_volume" :: held 0.976s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['247b6ebc-2548-48e5-b376-387230f23173', 'b41b0d03-b4df-4a2d-8491-aa0fbaaa0221', '2000bd0c-952b-4761-b607-b63d683eabee', '9c6a5512-41e7-4d5f-8ea3-d16dcc9b8532'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:54 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:54 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-98dca458-fcd7-4141-9424-d5ef1e188a7c-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-98dca458-fcd7-4141-9424-d5ef1e188a7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-98dca458-fcd7-4141-9424-d5ef1e188a7c" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-98dca458-fcd7-4141-9424-d5ef1e188a7c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleting offline snapshot 98dca458-fcd7-4141-9424-d5ef1e188a7c of volume 69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] snapshot_file for this snap is: volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b7a593-5858-4873-afa3-f998bf2eefc7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:55 devstack sudo[91249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c
Apr 15 14:43:55 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:55 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5625dea3-7454-4ea4-b53c-32a99b9455c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cddc2b-ef23-4714-80db-52383f4a2a17]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:55 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:43:55 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:55 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleted volume successfully.
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffaa11c8-2e27-486d-bd93-4d55d2861b9e tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-c8203174-80ac-428c-86ca-589508b50efd-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-c51a12df-8656-4046-89bd-827534739418-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:55 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-c51a12df-8656-4046-89bd-827534739418-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0ab837-58f7-4808-bdf1-ec713beecb15]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-quobyte-c51a12df-8656-4046-89bd-827534739418" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-c51a12df-8656-4046-89bd-827534739418" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f375cf5-5649-4625-a08b-3aad5079dbea]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:55 devstack sudo[91260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b
Apr 15 14:43:55 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:55 devstack sudo[91264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418
Apr 15 14:43:55 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:55 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:43:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:55 devstack sudo[91267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe
Apr 15 14:43:55 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:56 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" returned: 0 in 0.558s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:56 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c
Apr 15 14:43:56 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:56 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:56 devstack sudo[91281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418
Apr 15 14:43:56 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:57 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c" returned: 0 in 1.186s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:57 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c
Apr 15 14:43:57 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:57 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-c51a12df-8656-4046-89bd-827534739418" returned: 0 in 1.329s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-c51a12df-8656-4046-89bd-827534739418" released by "delete_volume" :: held 1.924s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created reservations ['ad1fbe3d-7fb6-41a2-9ea3-28413751c86f', 'f1d833a2-2da3-4807-b4c6-e8b0c85865a2', 'bf1bdf22-c585-49bc-9f44-bedd20dca871', 'bbe3a963-9045-42ed-9138-7ec1e6b6f573'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:57 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:57 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-73ede3aa-f11f-46b0-98cb-d299b7874798-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-73ede3aa-f11f-46b0-98cb-d299b7874798-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-quobyte-73ede3aa-f11f-46b0-98cb-d299b7874798" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-73ede3aa-f11f-46b0-98cb-d299b7874798" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99df81-e7de-49ec-a7f4-e097d445ee46]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:58 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe" returned: 0 in 2.440s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fd4ec5-8247-436d-bc49-351e8eea8130]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:58 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798
Apr 15 14:43:58 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:58 devstack sudo[91299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:43:58 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:58 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.575s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Deleted volume successfully.
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6673c9b2-76e2-4116-9b00-ddc3ee60d3e2 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-c51a12df-8656-4046-89bd-827534739418-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:58 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b.98dca458-fcd7-4141-9424-d5ef1e188a7c" returned: 0 in 1.045s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-98dca458-fcd7-4141-9424-d5ef1e188a7c" released by "_delete_snapshot" :: held 3.377s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" released by "delete_snapshot" :: held 3.390s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['5dd23273-bcbb-4d51-a0de-2a94e9380d7c', '945e03d1-a68c-4210-b710-6d2d9bdbc016', 'c1446613-67f5-4a12-b030-e7318c2fbd0c', 'a80ec53b-a840-4884-8bcb-bd3823ff1f68'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Delete snapshot completed successfully.
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd64041e-6c12-430b-bc00-f9733eed344f tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-98dca458-fcd7-4141-9424-d5ef1e188a7c-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:58 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:58 devstack sudo[91309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798
Apr 15 14:43:58 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:58 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:43:58 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Converted 1024.00 MB image at 419.31 MB/s
Apr 15 14:43:58 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe is being set with open permissions: ugo+rw
Apr 15 14:43:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:58 devstack sudo[91312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe
Apr 15 14:43:58 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:59 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-73ede3aa-f11f-46b0-98cb-d299b7874798" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-73ede3aa-f11f-46b0-98cb-d299b7874798" released by "delete_volume" :: held 0.960s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created reservations ['94c61479-a0b0-4346-85d5-dbf296a2e656', '7533fbb0-2d4e-4848-b4db-2ba39eb9b261', '51fd6cb6-8421-4093-a002-272145eb78f1', '8bd24ab4-d419-4016-bb6c-73bafd4fa85b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:59 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:43:59 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "cinder-quobyte-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:43:59 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[297a3a6e-49c7-477c-b3cd-70ebf8b9e5e3]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-83d38382-edf0-41dd-9428-56b983ac5ebe" released by "_copy_volume_from_snapshot" :: held 4.665s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-841728f5-1017-4149-bdcf-770a59df2d31-83d38382-edf0-41dd-9428-56b983ac5ebe" released by "_create_volume_from_snapshot" :: held 4.693s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.735s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.918s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:43:59 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Cloning volume d81ac579-180e-4977-b2af-0bc4333d9431 to volume cf41b2e5-d783-4595-889d-9bb12b0da748
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Creating offline snapshot 376bb593-0c63-467a-b157-71e5286014c7 of volume d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3246a730-8588-49f3-bcc2-71be5c8ef75f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:59 devstack sudo[91318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b
Apr 15 14:43:59 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3406f45-17d2-44b8-8832-7e53ab626860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d38382-edf0-41dd-9428-56b983ac5ebe', 'volume_size': 1, 'snapshot_id': '841728f5-1017-4149-bdcf-770a59df2d31'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c08148-1663-4d96-b9f3-3463b39f1fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:43:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Volume volume-83d38382-edf0-41dd-9428-56b983ac5ebe (83d38382-edf0-41dd-9428-56b983ac5ebe): created successfully
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c08148-1663-4d96-b9f3-3463b39f1fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Flow 'volume_create_manager' (d5466d29-ef96-4ade-a7e5-26c10d335055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:43:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5b5ec1ee-08e3-46cf-8aac-70a0246cd919 tempest-SnapshotDependencyTests-1826917876 None] Created volume successfully.
Apr 15 14:43:59 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:43:59 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:59 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:43:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Deleted volume successfully.
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dc7904b-0b5b-480d-ba7d-29fafe7d299b tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-73ede3aa-f11f-46b0-98cb-d299b7874798-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:43:59 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" returned: 0 in 0.493s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:59 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b
Apr 15 14:43:59 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:43:59 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:43:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:43:59 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 1G
Apr 15 14:43:59 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-841728f5-1017-4149-bdcf-770a59df2d31-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-841728f5-1017-4149-bdcf-770a59df2d31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-quobyte-5625dea3-7454-4ea4-b53c-32a99b9455c1" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-5625dea3-7454-4ea4-b53c-32a99b9455c1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-quobyte-841728f5-1017-4149-bdcf-770a59df2d31" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-841728f5-1017-4149-bdcf-770a59df2d31" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Deleting offline snapshot 841728f5-1017-4149-bdcf-770a59df2d31 of volume 5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] snapshot_file for this snap is: volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3469bc78-0486-45f4-80c9-d7d6e92e8564]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31
Apr 15 14:44:00 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-3f12d7f7-04e1-4376-8604-a8ded29df5e2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:00 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" returned: 0 in 0.482s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-3f12d7f7-04e1-4376-8604-a8ded29df5e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-quobyte-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b" released by "delete_volume" :: held 1.017s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-quobyte-3f12d7f7-04e1-4376-8604-a8ded29df5e2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-3f12d7f7-04e1-4376-8604-a8ded29df5e2" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba4f735-aa51-48cb-805e-72ecfcda94d7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Created reservations ['77fe844b-6e4c-454b-a79e-bd679b097652', 'f45b8bc4-9427-4693-980b-4873390111b7', '7e84e027-4d24-46aa-b00c-345875f5522c', 'd68aaa59-0ba6-4dc9-ba3d-bc00fddc2a02'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:00 devstack sudo[91339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:00 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 1G" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81ac579-180e-4977-b2af-0bc4333d9431 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack sudo[91341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:00 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81ac579-180e-4977-b2af-0bc4333d9431 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7
Apr 15 14:44:00 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31" returned: 0 in 0.558s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5625dea3-7454-4ea4-b53c-32a99b9455c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[832b53a1-e0a5-45af-9b5d-0bb0591ee7aa]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack sudo[91348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:44:00 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack sudo[91359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2
Apr 15 14:44:00 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:00 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Deleted volume successfully.
Apr 15 14:44:00 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c6e92548-f969-478f-a17c-5d6a2d13c6fc tempest-CreateVolumesFromSnapshotTest-2058202813 None] Lock "cinder-69915cdb-2c6d-42fd-91ff-fbd9f1adf66b-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81ac579-180e-4977-b2af-0bc4333d9431 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:00 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 is being set with open permissions: ugo+rw
Apr 15 14:44:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:00 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7
Apr 15 14:44:00 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:01 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:01 devstack sudo[91367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31
Apr 15 14:44:01 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:01 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-3f12d7f7-04e1-4376-8604-a8ded29df5e2" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-3f12d7f7-04e1-4376-8604-a8ded29df5e2" released by "delete_volume" :: held 1.000s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created reservations ['98dfc058-49d0-4ba2-a127-7a93d5e2fbad', '42b68e20-f412-4e08-b775-ad38309eb84c', 'ed7cf92e-4e4a-42d1-9ef5-874419527773', 'a8d614f7-6686-485b-9bec-76232d19bada'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:01 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7" returned: 0 in 0.462s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:01 devstack sudo[91370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info
Apr 15 14:44:01 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:01 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:01 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:01 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:01 devstack sudo[91377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31
Apr 15 14:44:01 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:01 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:01 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info is being set with open permissions: ugo+rw
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:01 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.514s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Deleted volume successfully.
Apr 15 14:44:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecd3946d-268f-4685-a491-20d40a88b28d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-3f12d7f7-04e1-4376-8604-a8ded29df5e2-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:01 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info
Apr 15 14:44:01 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:02 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1.841728f5-1017-4149-bdcf-770a59df2d31" returned: 0 in 0.537s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-841728f5-1017-4149-bdcf-770a59df2d31" released by "_delete_snapshot" :: held 2.190s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-5625dea3-7454-4ea4-b53c-32a99b9455c1" released by "delete_snapshot" :: held 2.204s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Created reservations ['36e7f8ca-63b2-46be-b843-076a4c9116e1', 'b05d0ff3-5bf5-4387-a471-ed4ff208ee0d', 'c7bce992-4db1-4398-a8d9-47af6a9edb79', '73e10da3-e534-4cd1-b9c2-dc76ff3ef5fe'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Delete snapshot completed successfully.
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-afea9856-356d-4767-a1a5-49d6a665e113 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-841728f5-1017-4149-bdcf-770a59df2d31-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:02 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.info" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-cf41b2e5-d783-4595-889d-9bb12b0da748" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-cf41b2e5-d783-4595-889d-9bb12b0da748" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] snapshot: 376bb593-0c63-467a-b157-71e5286014c7, volume: cf41b2e5-d783-4595-889d-9bb12b0da748,  {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f49df-9ab3-40de-abe1-9890e42cecfc]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-quobyte-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3" acquired by "delete_volume" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b5131-2963-46a2-8624-132ab39fb435]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:02 devstack sudo[91385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7
Apr 15 14:44:02 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:02 devstack sudo[91386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3
Apr 15 14:44:02 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:03 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81ac579-180e-4977-b2af-0bc4333d9431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] will copy from snapshot at /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71bc82-837d-4bc8-8c34-7746964cc24f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:03 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3" returned: 0 in 0.575s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:INSERT=63,cinder:UPDATE=237,cinder:SELECT=173,cinder:DELETE=22 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:44:03 devstack sudo[91397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3
Apr 15 14:44:03 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:03 devstack sudo[91396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:44:03 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Flow 'volume_create_manager' (d4eba87d-18a7-4d2b-95ab-7d3f5f898068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e0d5bd-fb3a-4d30-94c5-78a57b710214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e0d5bd-fb3a-4d30-94c5-78a57b710214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5835a416-379c-45fe-94ec-c6c95ac98f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8afff118a1499d971448ec7d03b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:44:03Z,use_quota=True,user_id='994740d0180549fe817ee16029a39a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42647d5b-4b9e-46fa-a001-e6da3ae29fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42647d5b-4b9e-46fa-a001-e6da3ae29fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70e840-6093-4b8b-9f88-42ac3a3cb232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70e840-6093-4b8b-9f88-42ac3a3cb232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5835a416-379c-45fe-94ec-c6c95ac98f93', 'volume_name': 'volume-5835a416-379c-45fe-94ec-c6c95ac98f93', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68443446-2c54-49dc-8af4-5ac4a5dceadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68443446-2c54-49dc-8af4-5ac4a5dceadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcaa8d4-aaea-42c3-ac4e-72956efcd820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Volume 5835a416-379c-45fe-94ec-c6c95ac98f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5835a416-379c-45fe-94ec-c6c95ac98f93', 'volume_size': 1}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-5625dea3-7454-4ea4-b53c-32a99b9455c1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-5625dea3-7454-4ea4-b53c-32a99b9455c1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-quobyte-5625dea3-7454-4ea4-b53c-32a99b9455c1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-5625dea3-7454-4ea4-b53c-32a99b9455c1" acquired by "delete_volume" :: waited 0.006s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c6078-79b6-4d27-bee7-d5d77d8f724a]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:03 devstack sudo[91400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:44:03 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:03 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Path /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:03 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3" released by "delete_volume" :: held 1.109s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:03 devstack sudo[91406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748
Apr 15 14:44:03 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created reservations ['14abb8a7-c143-42e1-ba76-d54326a252aa', 'd7d1c066-4ce8-4530-ac38-c5dd6ad20fd5', '24f78ab8-b73a-4f9c-b48b-8517ec183780', '9f84c051-a908-4b74-a54e-4e6e9caea2f3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:03 devstack sudo[91408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:03 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:03 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 0.511s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:03 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1
Apr 15 14:44:03 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:04 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.899s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Deleted volume successfully.
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fabc6a2e-2ce6-4e70-91d8-a6e43c239264 tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-9e8137e1-a9f7-44f6-b61a-0ba8d85b6ca3-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-02e36fac-0bcd-4235-ba08-e34c179bd36c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-02e36fac-0bcd-4235-ba08-e34c179bd36c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-quobyte-02e36fac-0bcd-4235-ba08-e34c179bd36c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-02e36fac-0bcd-4235-ba08-e34c179bd36c" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:04 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5625dea3-7454-4ea4-b53c-32a99b9455c1" returned: 0 in 1.020s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[caebadd7-780a-4358-b49d-363b06e9f332]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-5625dea3-7454-4ea4-b53c-32a99b9455c1" released by "delete_volume" :: held 1.626s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Created reservations ['b2114b7a-27cb-499a-8e40-66801f345271', 'a3b68690-d0bd-4510-a378-9af6f8cb7182', '51087313-8570-4f97-a2e4-47ec24afc52d', '405ee1df-ebf7-4b34-8869-c01ae70bd1fa'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:05 devstack sudo[91427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:05 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:05 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:05 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-83d38382-edf0-41dd-9428-56b983ac5ebe-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-83d38382-edf0-41dd-9428-56b983ac5ebe-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "cinder-quobyte-83d38382-edf0-41dd-9428-56b983ac5ebe" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-83d38382-edf0-41dd-9428-56b983ac5ebe" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eef8a0-a62c-419c-b8de-26122a8d862f]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:05 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748" returned: 0 in 2.342s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279d811-7129-436a-91fe-9fcc970b64d4]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:06 devstack sudo[91431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe
Apr 15 14:44:06 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:06 devstack sudo[91432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:44:06 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:06 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c" returned: 0 in 1.275s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:06 devstack sudo[91439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c
Apr 15 14:44:06 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:06 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.913s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Deleted volume successfully.
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3073e9a1-91c5-44be-a258-2dfa4febe6d0 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-5625dea3-7454-4ea4-b53c-32a99b9455c1-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:06 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe" returned: 0 in 0.503s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:06 devstack sudo[91446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe
Apr 15 14:44:06 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:06 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-02e36fac-0bcd-4235-ba08-e34c179bd36c" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-02e36fac-0bcd-4235-ba08-e34c179bd36c" released by "delete_volume" :: held 1.772s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:06 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.650s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Image conversion details: src /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 15 14:44:06 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Converted 1024.00 MB image at 436.74 MB/s
Apr 15 14:44:06 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 is being set with open permissions: ugo+rw
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:06 devstack sudo[91450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748
Apr 15 14:44:06 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created reservations ['ecf5120f-bded-4329-8eb2-6c608a74dd27', '08752fd9-67f9-4bcc-9e69-b8ae1ee0947f', '3df53bb7-1827-48b2-b478-04a7f5136566', 'ec06936f-1ba8-457e-9d5a-9899338692d0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:06 devstack sudo[91452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:06 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:06 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-83d38382-edf0-41dd-9428-56b983ac5ebe" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-quobyte-83d38382-edf0-41dd-9428-56b983ac5ebe" released by "delete_volume" :: held 1.000s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "cinder-quobyte-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Created reservations ['25eb3a3f-3027-44e4-ae9c-7da6a00f84ab', '74e25d6e-aab7-4105-b07b-4f9f69f02404', '819fca1c-a279-4fa3-9729-6fb952806cc2', '93d3c5ea-fd57-408c-8a59-e725e5b34521'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100e470-2c3a-41c8-b2d6-3468d746ea16]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:07 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-cf41b2e5-d783-4595-889d-9bb12b0da748" released by "_copy_volume_from_snapshot" :: held 4.654s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:07 devstack sudo[91458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-376bb593-0c63-467a-b157-71e5286014c7" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:07 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:07 devstack sudo[91456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c
Apr 15 14:44:07 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-376bb593-0c63-467a-b157-71e5286014c7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Deleting offline snapshot 376bb593-0c63-467a-b157-71e5286014c7 of volume d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] snapshot_file for this snap is: volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d260104-4d7e-4873-a3e1-c0fc178e1b01]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:07 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Deleted volume successfully.
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b2015258-8f5c-48d3-ae68-b02caf468e3d tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-02e36fac-0bcd-4235-ba08-e34c179bd36c-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:07 devstack sudo[91461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7
Apr 15 14:44:07 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:07 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.445s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Deleted volume successfully.
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3f18dc01-d2e5-40cb-a6e2-82bbf450ecf5 tempest-SnapshotDependencyTests-1826917876 None] Lock "cinder-83d38382-edf0-41dd-9428-56b983ac5ebe-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:07 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:07 devstack sudo[91470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c
Apr 15 14:44:07 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:07 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81ac579-180e-4977-b2af-0bc4333d9431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea391637-d37a-4b77-b8d8-759a355b0cc8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:07 devstack sudo[91472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:44:07 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:08 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c" returned: 0 in 0.451s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-quobyte-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c" released by "delete_volume" :: held 1.005s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Created reservations ['309040ed-0abf-4698-8ead-39891d97b4fc', '2b0a962a-d654-4319-9d41-2653f3c9bfa8', 'f3923713-282c-47c7-8085-a84bbe63175e', 'b702e672-8fd3-40e3-aefc-3177ffaed1cd'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:08 devstack sudo[91479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:08 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:08 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.538s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:08 devstack sudo[91481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7
Apr 15 14:44:08 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:08 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.422s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Deleted volume successfully.
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-af7c623d-39dc-481c-8d1a-300a759618cf tempest-CreateVolumesFromSourceVolumeTest-1641966511 None] Lock "cinder-738bd018-8abd-4a67-aba9-ab0d0e7d3e9c-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:08 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:08 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7
Apr 15 14:44:08 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:09 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431.376bb593-0c63-467a-b157-71e5286014c7" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-376bb593-0c63-467a-b157-71e5286014c7" released by "_delete_snapshot" :: held 2.092s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.935s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.994s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5835a416-379c-45fe-94ec-c6c95ac98f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8afff118a1499d971448ec7d03b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:44:03Z,use_quota=True,user_id='994740d0180549fe817ee16029a39a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Creating volume 5835a416-379c-45fe-94ec-c6c95ac98f93 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:44:09 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac02967-83f7-48ce-a253-b955f4ad5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf41b2e5-d783-4595-889d-9bb12b0da748', 'volume_size': 1, 'source_volid': 'd81ac579-180e-4977-b2af-0bc4333d9431', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:09 devstack sudo[91491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93 1073741824
Apr 15 14:44:09 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268cb069-3e58-4656-aa42-cf180240ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Volume volume-cf41b2e5-d783-4595-889d-9bb12b0da748 (cf41b2e5-d783-4595-889d-9bb12b0da748): created successfully
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268cb069-3e58-4656-aa42-cf180240ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Flow 'volume_create_manager' (99203a41-03ea-4bdd-a259-8a474657c292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:44:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-563d78d6-1b02-4964-8295-1666c9b7ce76 tempest-VolumeDependencyTests-130649381 None] Created volume successfully.
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-d81ac579-180e-4977-b2af-0bc4333d9431-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-d81ac579-180e-4977-b2af-0bc4333d9431-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-d81ac579-180e-4977-b2af-0bc4333d9431" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:09 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-d81ac579-180e-4977-b2af-0bc4333d9431" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93 1073741824" returned: 0 in 0.744s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ae2a07-3509-4127-9bd6-94584c9fcd50]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:10 devstack sudo[91497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93
Apr 15 14:44:10 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:10 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:44:10 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:10 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcaa8d4-aaea-42c3-ac4e-72956efcd820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5835a416-379c-45fe-94ec-c6c95ac98f93', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b0f02c-94f2-4664-8d18-e45a8fb2fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:10 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Volume volume-5835a416-379c-45fe-94ec-c6c95ac98f93 (5835a416-379c-45fe-94ec-c6c95ac98f93): created successfully
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b0f02c-94f2-4664-8d18-e45a8fb2fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Flow 'volume_create_manager' (d4eba87d-18a7-4d2b-95ab-7d3f5f898068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:44:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3324111a-ff6d-4ccd-b594-bca2c6613357 tempest-CinderUnicodeTest-209236744 None] Created volume successfully.
Apr 15 14:44:10 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.638s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:10 devstack sudo[91505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431
Apr 15 14:44:10 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Flow 'volume_create_manager' (a674f73e-0065-476f-9271-ea161709381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad59766-8b47-4b7b-9526-58fdd9fb2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:11 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad59766-8b47-4b7b-9526-58fdd9fb2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:44:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1429474141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d06c03-936a-4fd8-a390-a94a68d0cc58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8afff118a1499d971448ec7d03b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:44:11Z,use_quota=True,user_id='994740d0180549fe817ee16029a39a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47bd163-cffa-427e-a2e9-b43db0e498bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47bd163-cffa-427e-a2e9-b43db0e498bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f498083-65b1-440f-9450-d0607f81c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f498083-65b1-440f-9450-d0607f81c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d06c03-936a-4fd8-a390-a94a68d0cc58', 'volume_name': 'volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31527a27-f7fb-42cd-abff-a001cfade57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31527a27-f7fb-42cd-abff-a001cfade57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925807b2-2267-4d8d-9003-68d2d748be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Volume b4d06c03-936a-4fd8-a390-a94a68d0cc58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58', 'volume_size': 1}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa4bba06dd0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-15T12:44:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1429474141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d06c03-936a-4fd8-a390-a94a68d0cc58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8afff118a1499d971448ec7d03b8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T12:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T12:44:11Z,use_quota=True,user_id='994740d0180549fe817ee16029a39a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98294827-8fe2-4e64-addc-7ff7342e7c01),volume_type_id=98294827-8fe2-4e64-addc-7ff7342e7c01)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Creating volume b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Selected osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 15 14:44:11 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] casted to osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-d81ac579-180e-4977-b2af-0bc4333d9431" returned: 0 in 0.586s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:11 devstack sudo[91508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 1073741824
Apr 15 14:44:11 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-d81ac579-180e-4977-b2af-0bc4333d9431" released by "delete_volume" :: held 1.268s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Created reservations ['2eb4e4ef-c092-436b-a8e4-f8199f59b3d6', '9a992a0c-5ebb-4f62-a5af-4128d6a5526e', 'fe91590c-e611-4df1-9175-258e4b9eaf71', '890085fc-02ab-4e7f-900e-36f1f6ff92ce'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:11 devstack sudo[91510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:11 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:11 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 1073741824" returned: 0 in 0.529s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:11 devstack sudo[91517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58
Apr 15 14:44:11 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:11 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Deleted volume successfully.
Apr 15 14:44:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-23e8d6fb-0436-47b8-9a4b-cce31d72b7b6 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-d81ac579-180e-4977-b2af-0bc4333d9431-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-cf41b2e5-d783-4595-889d-9bb12b0da748-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-cf41b2e5-d783-4595-889d-9bb12b0da748-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-cf41b2e5-d783-4595-889d-9bb12b0da748" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-cf41b2e5-d783-4595-889d-9bb12b0da748" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf09dc-4c5e-4cb6-b861-db3ae2b46d57]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:12 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925807b2-2267-4d8d-9003-68d2d748be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8620d-6813-4e77-b079-d997349dc83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 15 14:44:12 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748
Apr 15 14:44:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Volume volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 (b4d06c03-936a-4fd8-a390-a94a68d0cc58): created successfully
Apr 15 14:44:12 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8620d-6813-4e77-b079-d997349dc83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Flow 'volume_create_manager' (a674f73e-0065-476f-9271-ea161709381b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 15 14:44:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-249b23e7-15a2-4451-883f-b7c1eabf5045 tempest-CinderUnicodeTest-209236744 None] Created volume successfully.
Apr 15 14:44:12 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:12 devstack sudo[91525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748
Apr 15 14:44:12 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:13 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-cf41b2e5-d783-4595-889d-9bb12b0da748" returned: 0 in 0.489s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-cf41b2e5-d783-4595-889d-9bb12b0da748" released by "delete_volume" :: held 0.983s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Created reservations ['8d408aef-0b68-4a09-9843-c4c18c30e227', '240d2af5-ecf3-40cf-b9ba-d00ac942014b', '795f4d11-ddc7-4530-a104-17a29b19f653', 'f6cdc552-6326-4df4-a9f0-65ca15be4e14'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:13 devstack sudo[91529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:13 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-94eccc09-7bc2-4bc9-96c8-55e72ab80c48-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Lock "cinder-94eccc09-7bc2-4bc9-96c8-55e72ab80c48-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Acquiring lock "cinder-quobyte-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efe715-28f0-4d33-b993-db80e6b3a1c7]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:13 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48
Apr 15 14:44:13 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Creating offline snapshot 625ee871-403e-4777-bf51-5854e71811fe of volume b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[86511a24-10c4-44d3-8d96-3d4e1322aca8]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:13 devstack sudo[91533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58
Apr 15 14:44:13 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:13 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Deleted volume successfully.
Apr 15 14:44:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bd37be30-8d0a-49e0-bca8-74e0360a58c8 tempest-VolumeDependencyTests-130649381 None] Lock "cinder-cf41b2e5-d783-4595-889d-9bb12b0da748-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:14 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" returned: 0 in 0.608s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:14 devstack sudo[91541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48
Apr 15 14:44:14 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:14 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58" returned: 0 in 0.593s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:14 devstack sudo[91544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe 1G
Apr 15 14:44:14 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:14 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" returned: 0 in 0.514s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Lock "cinder-quobyte-94eccc09-7bc2-4bc9-96c8-55e72ab80c48" released by "delete_volume" :: held 1.159s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Created reservations ['7fab3e13-589a-4455-bd00-4a0be49141e2', '0f57a845-55e4-4d93-8477-471eb2ffa568', '412b1b29-bd03-4deb-b52b-0be7a7fbcea7', '47c10988-05bb-4d5a-ac90-4e38fe6c2caa'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:14 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:14 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:14 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe 1G" returned: 0 in 0.618s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:14 devstack sudo[91552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe
Apr 15 14:44:14 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:15 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Deleted volume successfully.
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-65450218-3a12-4e4f-8f44-11e0aa115a9a tempest-VolumeDependencyTests-130649381 None] Lock "cinder-94eccc09-7bc2-4bc9-96c8-55e72ab80c48-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:15 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 -F qcow2 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe" returned: 0 in 0.445s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:15 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe is being set with open permissions: ugo+rw
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:15 devstack sudo[91558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe
Apr 15 14:44:15 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:15 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:15 devstack sudo[91561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info
Apr 15 14:44:15 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:16 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info" returned: 0 in 0.448s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:16 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info is being set with open permissions: ugo+rw
Apr 15 14:44:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:16 devstack sudo[91564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info
Apr 15 14:44:16 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:16 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.info" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-00f80737-482d-4be1-ac8d-32688ef4dbdd tempest-CinderUnicodeTest-209236744 None] Create snapshot completed successfully
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-625ee871-403e-4777-bf51-5854e71811fe-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Lock "cinder-625ee871-403e-4777-bf51-5854e71811fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-quobyte-b4d06c03-936a-4fd8-a390-a94a68d0cc58" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-b4d06c03-936a-4fd8-a390-a94a68d0cc58" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-quobyte-625ee871-403e-4777-bf51-5854e71811fe" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-625ee871-403e-4777-bf51-5854e71811fe" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Deleting offline snapshot 625ee871-403e-4777-bf51-5854e71811fe of volume b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] snapshot_file for this snap is: volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c197051-643c-4a28-b132-4ed173c591da]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:17 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe
Apr 15 14:44:17 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:18 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 15 14:44:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f5ec35-c3dd-4fa8-b100-22cb56b75ce0]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:18 devstack sudo[91573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58
Apr 15 14:44:18 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:18 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:18 devstack sudo[91578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe
Apr 15 14:44:18 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:19 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe" returned: 0 in 0.450s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:19 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe
Apr 15 14:44:19 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:19 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58.625ee871-403e-4777-bf51-5854e71811fe" returned: 0 in 0.416s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-625ee871-403e-4777-bf51-5854e71811fe" released by "_delete_snapshot" :: held 1.863s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-b4d06c03-936a-4fd8-a390-a94a68d0cc58" released by "delete_snapshot" :: held 1.876s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Created reservations ['d621fb74-1614-4f20-b7b4-0e0e1a081d69', '21c785dc-deae-4b51-b028-d454617c3a4d', '387834b2-1b8d-47bb-8a9b-7042b124d55c', '2fbbf126-6ca3-4a81-99f6-d4a1b8642087'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Delete snapshot completed successfully.
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-09983d34-3c33-4420-ba59-dc0be11c58a4 tempest-CinderUnicodeTest-209236744 None] Lock "cinder-625ee871-403e-4777-bf51-5854e71811fe-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-b4d06c03-936a-4fd8-a390-a94a68d0cc58-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-b4d06c03-936a-4fd8-a390-a94a68d0cc58-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-quobyte-b4d06c03-936a-4fd8-a390-a94a68d0cc58" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-b4d06c03-936a-4fd8-a390-a94a68d0cc58" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5bcb5-5e61-4b43-836b-159f4311f991]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:19 devstack sudo[91586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58
Apr 15 14:44:19 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:20 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58" returned: 0 in 0.474s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:20 devstack sudo[91591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58
Apr 15 14:44:20 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:20 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-b4d06c03-936a-4fd8-a390-a94a68d0cc58" returned: 0 in 0.421s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-b4d06c03-936a-4fd8-a390-a94a68d0cc58" released by "delete_volume" :: held 0.931s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Created reservations ['a289d718-e196-4487-82fb-e54bd4027104', '62620301-c06c-4abd-8fc1-5ce53acd32ef', 'e9636c3b-3169-4cb6-bfb5-b52e5cf8f328', 'd1a9399e-39d1-4335-96f2-db188064655e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:20 devstack sudo[91594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:20 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-5835a416-379c-45fe-94ec-c6c95ac98f93-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-5835a416-379c-45fe-94ec-c6c95ac98f93-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Acquiring lock "cinder-quobyte-5835a416-379c-45fe-94ec-c6c95ac98f93" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-5835a416-379c-45fe-94ec-c6c95ac98f93" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bba14a-7005-4f3f-be1e-956f62a6eac2]: (4, 'qcow2') {{(pid=84004) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:21 devstack sudo[91596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93
Apr 15 14:44:21 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:21 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.420s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Deleted volume successfully.
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-68a201d8-0049-498e-9599-bb88183e901c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-b4d06c03-936a-4fd8-a390-a94a68d0cc58-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:21 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:21 devstack sudo[91602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93
Apr 15 14:44:21 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:21 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba/volume-5835a416-379c-45fe-94ec-c6c95ac98f93" returned: 0 in 0.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-quobyte-5835a416-379c-45fe-94ec-c6c95ac98f93" released by "delete_volume" :: held 0.920s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Created reservations ['83cd2075-0813-4cf8-be13-dcd2a147b765', 'dc9164d9-5f68-4389-8032-4bd69a7ba42f', '0526cb81-109c-4525-b476-6ce32c767090', '784a18e8-6498-4ac1-9afe-79a2295cfd5f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f123288a-2f94-4639-b517-a3c16f18e03b'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 15 14:44:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 15 14:44:22 devstack sudo[91605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba
Apr 15 14:44:22 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 15 14:44:22 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root
Apr 15 14:44:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/14914797014059c862c1439810546dba" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 15 14:44:22 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 15 14:44:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Deleted volume successfully.
Apr 15 14:44:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f553e0b2-2dab-44d1-9ad1-151c9493051c tempest-CinderUnicodeTest-209236744 None] Lock "cinder-5835a416-379c-45fe-94ec-c6c95ac98f93-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 15 14:44:31 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=66,cinder:UPDATE=91,cinder:DELETE=5,cinder:INSERT=19 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 15 14:44:32 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=151,cinder:UPDATE=212,cinder:INSERT=51,cinder:DELETE=18 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}